00000001:02000400:1.0F:1787786942.494826:0:3309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787786960.330467:0:3529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787786962.127863:0:3592:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 772 MB/s 00000001:01000000:3.0:1787786962.377791:0:3592:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 699 MB/s 00000001:01000000:0.0F:1787786962.627445:0:3592:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4691 MB/s 00000020:02000000:2.0F:1787786963.250278:0:3622:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_52_gc224de1 00000400:02000000:1.0:1787786964.188345:0:3637:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.131@tcp [8/256/0/180] 00008000:02000000:3.0:1787786967.502438:0:3786:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787787032.531744:0:5754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787787046.504800:0:6504:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787787046.504807:0:6504:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787787046.504808:0:6504:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787787046.504965:0:6504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b2bc8eee 00000080:02000400:2.0:1787787046.504978:0:6504:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787787046.517332:0:6504:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787787046.517347:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787787046.517389:0:6504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000872e9d0e) 00000020:00000080:2.0:1787787046.517408:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787787046.618344:0:6504:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787787046.618742:0:6504:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787787046.666897:0:6504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787787046.667673:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787787046.667684:0:6504:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787787046.667697:0:6504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a87ed 00000020:01000004:2.0:1787787046.667705:0:6504:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787787046.667709:0:6504:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787787046.667715:0:6504:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b2bc8eee from MGS 00000020:01000004:2.0:1787787046.667720:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787787046.667730:0:6504:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000d655f92) 00000020:00000080:2.0:1787787046.667741:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787787046.667821:0:6504:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b2bc8eee from MGS, refs=2 00080000:01000000:2.0:1787787046.667826:0:6504:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787787046.667831:0:6504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a87fb 00000100:00100000:2.0:1787787046.667926:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787787046.668062:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787787046.668068:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787787046.668810:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787787046.668817:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787787046.669742:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787046.669917:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787787046.669922:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787787046.670864:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787787046.670878:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787787046.671849:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787787046.671859:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787787046.673002:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787046.673007:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787046.673009:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787046.674587:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787046.674593:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787046.674595:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787046.675624:0:6504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787787046.680593:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787787046.925665:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2063 MB/s 00000001:01000000:3.0:1787787047.177162:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2750 MB/s 00000001:01000000:3.0:1787787047.430219:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 478 MB/s 00000001:01000000:3.0:1787787047.682447:0:6504:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 476 MB/s 00080000:10000000:0.0:1787787047.688321:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1787787047.697424:0:6504:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787787047.698109:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787787047.698195:0:6504:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787787047.698226:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787787047.698343:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787787047.698376:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787787047.698699:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787047.699199:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787787047.699206:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787787047.699909:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787787047.699916:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787787047.706943:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787787047.706959:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787787047.707735:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787787047.707758:0:6504:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.131@tcp' 00000020:01000004:2.0:1787787047.707760:0:6504:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787787047.707812:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.131@tcp (typ=mgc) 00000020:00000080:2.0:1787787047.707825:0:6504:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.131@tcp (00000000b58c159e) 00000020:00000080:2.0:1787787047.707840:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787787047.707933:0:6504:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000288ff983@MGC192.168.204.131@tcp: add connection 192.168.204.131@tcp at head 00000100:00080000:3.0:1787787047.708659:0:6523:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1787787047.708924:0:6504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.131@tcp-0 is initialized 00000040:01000000:2.0:1787787047.708932:0:6504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787787047.711658:0:6524:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787787047.711743:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.131@tcp (uuid 697ab143-19fe-4215-afba-68a282afbaf6) 00000020:00000080:3.0:1787787047.711766:0:6504:0:(genops.c:1385:class_connect()) connect: client 697ab143-19fe-4215-afba-68a282afbaf6, cookie 0x11620bc3f30a8809 00000100:00080000:3.0:1787787047.711779:0:6504:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787047.711784:0:6504:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import 00000000288ff983 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787047.711817:0:6504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004f4a2587 x1874630503563392/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787047.711844:0:6504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 697ab143-19fe-4215-afba-68a282afbaf6->MGS 00000100:00100000:0.0:1787787047.712044:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f4a2587 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503563392:0@lo:250: 00000100:00100000:0.0:1787787047.712111:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787047.712192:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503563392 00000100:00100000:0.0:1787787047.712199:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503563392 00000100:00100000:0.0:1787787047.712236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787047.712243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091699d26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3652:x1874630503563392:12345-0@lo:250: 00010000:00080000:0.0:1787787047.712263:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 697ab143-19fe-4215-afba-68a282afbaf6@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1787787047.712286:0:6519:0:(genops.c:1385:class_connect()) connect: client 697ab143-19fe-4215-afba-68a282afbaf6, cookie 0x11620bc3f30a8810 00000100:00080000:0.0:1787787047.712412:0:6519:0:(import.c:65:import_set_state_nolock()) 000000008b007ed8 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787047.712472:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091699d26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+5:3652:x1874630503563392:12345-0@lo:250: Request processed in 229us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787047.712481:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787047.712512:0:3652:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787787047.712519:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1787787047.712525:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787787047.712530:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787787047.712533:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000288ff983 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787787047.712535:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787787047.712542:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787787047.712546:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f4a2587 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503563392:0@lo:250: 00000020:01000004:3.0:1787787047.712799:0:6504:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787787047.712805:0:6504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787787047.712826:0:6504:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a9752188) 00000020:00000080:3.0:1787787047.712837:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00010000:1.0:1787787047.728596:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787047.730114:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787047.730382:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787787047.732228:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787787047.734390:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787787047.734403:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787787047.736840:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787787047.736851:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787787047.740018:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787047.740373:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787787047.740379:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787787047.740934:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787787047.740942:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787787047.787922:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787047.788384:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787787047.788391:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787787047.789918:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787787047.789932:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787787047.790807:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787047.790979:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787047.790984:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787787047.791721:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787787047.791730:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787787047.792525:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787047.792810:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787047.792815:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787787047.793544:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787047.793551:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787787047.794414:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787047.794594:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787787047.794605:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787787047.795109:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787787047.795116:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787787047.813935:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787047.814317:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787047.814323:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787787047.815662:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787047.815675:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787787047.816714:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787047.816724:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787787047.817567:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787787047.817598:0:6504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787787047.817604:0:6504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787787047.817716:0:6504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787787047.817750:0:6504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.131@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787787047.817755:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787787047.817757:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787047.817758:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787047.817759:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787047.817760:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787047.817761:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787047.817763:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787047.817764:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787047.817765:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787047.817766:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787047.817768:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787047.817770:0:6504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787047.817772:0:6504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787787047.817775:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787047.817776:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787047.817777:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787047.817778:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787047.817779:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787047.817780:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787047.817781:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787047.817782:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787047.817783:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787047.817784:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787047.817785:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787047.817786:0:6504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787047.817821:0:6504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787787047.817838:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba5d7c86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563520:0@lo:253: 00000100:00100000:0.0:1787787047.817922:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787047.818022:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093420000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787047.818350:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503563520 00000100:00100000:2.0:1787787047.818357:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503563520 00000100:00100000:2.0:1787787047.818461:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787047.818470:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f314f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+5:6504:x1874630503563520:12345-0@lo:253: 20000000:01000000:2.0:1787787047.818519:0:6522:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787787047.818522:0:6522:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787787047.818907:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787787047.818963:0:6522:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787787047.819312:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787047.820550:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787787047.820847:0:6522:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787787047.820853:0:6522:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787787047.820859:0:6522:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787787047.820862:0:6522:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787787047.820875:0:6522:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787787047.821567:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787047.821770:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787787047.821786:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787787047.821805:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787787047.821823:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787787047.821838:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787787047.821898:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787787047.821906:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787787047.821919:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787787047.821925:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787787047.821938:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787787047.821943:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787787047.821957:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787787047.821973:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787787047.821999:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787787047.822004:0:6522:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787787047.822011:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787047.822120:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787787047.822133:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787787047.822191:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787787047.822207:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787787047.822222:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787787047.822240:0:6522:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787787047.822271:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787787047.822279:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787787047.822293:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787787047.822326:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787787047.822343:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787787047.822352:0:6522:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787787047.822378:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787787047.822386:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787787047.822399:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787787047.822413:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787787047.822492:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787787047.822518:0:6522:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787787047.822525:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787787047.823401:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787787047.823613:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787787047.823635:0:6522:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.131@tcp for mdt 20000000:01000000:3.0:1787787047.823638:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787787047.823653:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787787047.823659:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787787047.823670:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787787047.823676:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:3.0:1787787047.823688:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787787047.823695:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787787047.823782:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787787047.823800:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787787047.823829:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787787047.823832:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787787047.823836:0:6522:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787787047.823892:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787787047.823894:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787787047.824456:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787787047.824631:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787787047.824654:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787787047.824670:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787787047.824679:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787787047.824681:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787787047.825010:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787787047.825279:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787787047.825296:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787787047.825307:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787787047.825317:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787047.825319:0:6522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787787047.825323:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787787047.825325:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787787047.825335:0:6522:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787787047.825341:0:6522:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787787047.825648:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787787047.825806:0:6522:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787787047.845463:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787787047.845572:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787787047.845591:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787787047.846619:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787787047.846650:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846669:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846680:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846685:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846707:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846713:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846718:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000adc1b1c4 already unused, calling callback (00000000edbd5163) 00010000:00010000:2.0:1787787047.846721:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846727:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846738:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846745:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787047.846750:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000adc1b1c4/0x11620bc3f30a881e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787787047.846769:0:6522:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787787047.865619:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f314f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+5:6504:x1874630503563520:12345-0@lo:253: Request processed in 47141us (47688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787047.865636:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787047.866095:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba5d7c86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563520:0@lo:253: 10000000:01000000:3.0:1787787047.866111:0:6504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787787047.866114:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787047.866116:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787047.866117:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787047.866118:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787787047.866119:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787047.866121:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787047.866122:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787047.866123:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787047.866125:0:6504:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787787047.866126:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787047.866128:0:6504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787787047.866177:0:6504:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b2bc8eee from lustre-MDT0000 10000000:01000000:3.0:1787787047.866207:0:6504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787787047.866210:0:6504:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787787047.866214:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9870d15599b8 10000000:01000000:3.0:1787787047.866218:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787047.866226:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9870d15599b8 from 1 10000000:01000000:3.0:1787787047.866229:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787787047.866267:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.866277:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.866285:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787047.866302:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563648:0@lo:101: 00000100:00100000:3.0:1787787047.866345:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787047.866395:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f26be49 going to sleep for 11 seconds 00000100:00100000:1.0:1787787047.869593:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503563648 00000100:00100000:1.0:1787787047.869609:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503563648 00000100:00100000:1.0:1787787047.869704:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787047.869713:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005846eeae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+5:6504:x1874630503563648:12345-0@lo:101: 00010000:00010000:1.0:1787787047.869729:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787047.869747:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8825 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787047.869770:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787047.869780:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787047.869787:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f371fe50, rc 0) 00000100:00100000:1.0:1787787047.869891:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005846eeae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+6:6504:x1874630503563648:12345-0@lo:101: Request processed in 179us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787047.869903:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787047.870091:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563648:0@lo:101: 00010000:00010000:3.0:1787787047.870109:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.870118:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787047.870246:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563776:0@lo:501: 00000100:00100000:3.0:1787787047.870286:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787047.870315:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f26be49 going to sleep for 11 seconds 00000100:00100000:2.0:1787787047.870405:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503563776 00000100:00100000:2.0:1787787047.870410:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503563776 00000100:00100000:2.0:1787787047.870444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787047.870451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008acd7af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+6:6504:x1874630503563776:12345-0@lo:501: 00000100:00100000:2.0:1787787047.870553:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008acd7af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+6:6504:x1874630503563776:12345-0@lo:501: Request processed in 103us (267us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787047.870560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787047.870859:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563776:0@lo:501: 10000000:01000000:3.0:1787787047.870886:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787787047.870902:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.870910:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787047.870919:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870c3240800 10000000:01000000:3.0:1787787047.870923:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787787047.870927:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9870c3240800 10000000:01000000:3.0:1787787047.870930:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787787047.870932:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9870c3240800 from 1 10000000:01000000:3.0:1787787047.870935:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787787047.870955:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.870973:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.870992:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787047.871005:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563904:0@lo:101: 00000100:00100000:3.0:1787787047.871030:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787047.871049:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f26be49 going to sleep for 11 seconds 00000100:00100000:0.0:1787787047.871208:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503563904 00000100:00100000:0.0:1787787047.871214:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503563904 00000100:00100000:0.0:1787787047.871236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787047.871241:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000290b816f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+6:6504:x1874630503563904:12345-0@lo:101: 00010000:00010000:0.0:1787787047.871248:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787047.871261:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007029aee2/0x11620bc3f30a883a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8833 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787047.871275:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007029aee2/0x11620bc3f30a883a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8833 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787047.871282:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007029aee2/0x11620bc3f30a883a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8833 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787047.871289:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007029aee2, rc 0) 00000100:00100000:0.0:1787787047.871317:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000290b816f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+7:6504:x1874630503563904:12345-0@lo:101: Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787047.871323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787047.871395:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503563904:0@lo:101: 00010000:00010000:3.0:1787787047.871405:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871412:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787047.871421:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787787047.871424:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871441:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000c5dde99a/0x11620bc3f30a8833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787047.871447:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787787047.871450:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787047.871454:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9870c3240800 10000000:01000000:3.0:1787787047.871457:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787787047.871460:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787787047.871468:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787787047.871551:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871559:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871565:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787047.871577:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564032:0@lo:101: 00000100:00100000:3.0:1787787047.871604:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787047.871630:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f26be49 going to sleep for 11 seconds 00000100:00100000:3.0:1787787047.871647:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564032 00000100:00100000:3.0:1787787047.871650:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564032 00000100:00100000:3.0:1787787047.871667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787047.871672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c22c24c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+7:6504:x1874630503564032:12345-0@lo:101: 00010000:00010000:3.0:1787787047.871678:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787047.871686:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8841 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871698:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871706:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787047.871712:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073d36be4, rc 0) 00000100:00100000:3.0:1787787047.871738:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c22c24c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+8:6504:x1874630503564032:12345-0@lo:101: Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787047.871746:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001659cf3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564032:0@lo:101: 00000100:00100000:3.0:1787787047.871752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787787047.871755:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787047.871762:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787047.871805:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd78326c pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564160:0@lo:501: 00000100:00100000:1.0:1787787047.871830:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787047.871851:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c694759a going to sleep for 11 seconds 00000100:00100000:3.0:1787787047.872066:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564160 00000100:00100000:3.0:1787787047.872071:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564160 00000100:00100000:3.0:1787787047.872101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787047.872107:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000829f8fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+8:6504:x1874630503564160:12345-0@lo:501: 00000100:00100000:3.0:1787787047.872231:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000829f8fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+9:6504:x1874630503564160:12345-0@lo:501: Request processed in 123us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787047.872238:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787047.875005:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd78326c pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564160:0@lo:501: 00000100:00100000:1.0:1787787047.875086:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd78326c pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564288:0@lo:503: 00000100:00100000:1.0:1787787047.875213:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787047.875248:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c694759a going to sleep for 11 seconds 00000100:00100000:1.0:1787787047.875276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564288 00000100:00100000:1.0:1787787047.875283:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564288 00000100:00100000:1.0:1787787047.875324:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787047.875331:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6a44bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+9:6504:x1874630503564288:12345-0@lo:503: 00000100:00100000:1.0:1787787047.875467:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6a44bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+9:6504:x1874630503564288:12345-0@lo:503: Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787047.875475:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787047.875598:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd78326c pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564288:0@lo:503: 00000100:00100000:3.0:1787787047.876744:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ba04dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6549:1874630503564416:0@lo:502: 00000100:00100000:3.0:1787787047.876802:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787047.876937:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 00000000697c973d going to sleep for 11 seconds 00000100:00100000:1.0:1787787047.882686:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564416 00000100:00100000:1.0:1787787047.882716:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564416 00000100:00100000:1.0:1787787047.882798:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787047.882807:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000306006bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+9:6549:x1874630503564416:12345-0@lo:502: 00000100:00100000:1.0:1787787047.883536:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000306006bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+9:6549:x1874630503564416:12345-0@lo:502: Request processed in 728us (6733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787047.883547:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787047.883605:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ba04dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6549:1874630503564416:0@lo:502: 00000020:01000000:3.0:1787787047.883642:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787047.883654:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787047.883657:0:6549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787787047.883661:0:6549:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787787047.883664:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787047.883678:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b11c7c92) 00000020:00000080:3.0:1787787047.883693:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787787047.883698:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787787047.883805:0:6549:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787787047.883812:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a8856 00000020:00000080:3.0:1787787047.884174:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787787047.884181:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787047.884185:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787047.884187:0:6549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787787047.884190:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787047.884194:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787047.884202:0:6549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787787047.884207:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787047.884214:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000028c96009) 00000020:00000080:3.0:1787787047.884225:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787787047.884229:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787787047.884230:0:6549:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787787047.884233:0:6549:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787787047.884239:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787787047.884283:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b2bc8eee from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787787047.884295:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000dd55511d) 00000020:00000080:3.0:1787787047.884302:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787787047.884443:0:6549:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787787047.884448:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a886b 00000020:00000080:3.0:1787787047.886521:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787787047.886534:0:6549:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787787047.886543:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x11620bc3f30a8872 00080000:01000000:3.0:1787787047.886550:0:6549:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787787047.886553:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a8879 00080000:10000000:3.0:1787787047.887601:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787787047.887775:0:6549:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787787047.900393:0:6549:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787787048.072687:0:6549:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787787048.076884:0:6549:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787787048.082261:0:6549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787787048.087321:0:6549:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787787048.096568:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001cc67f36) 00000020:00000080:2.0:1787787048.096592:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787787048.096673:0:6549:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787787048.096681:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a8887 00000020:00000080:2.0:1787787048.115898:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787787048.116687:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787787048.120552:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787787048.123256:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787787048.138926:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787787048.144354:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787787048.147610:0:6549:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787787048.153315:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x11620bc3f30a888e 00000020:00000080:1.0:1787787048.154260:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787787048.154274:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787048.154280:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787048.154283:0:6549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787787048.154285:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787048.154289:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787048.154290:0:6549:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787787048.154293:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787787048.154295:0:6549:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787787048.154297:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787048.154300:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787048.154301:0:6549:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787787048.154302:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787048.154306:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787048.154307:0:6549:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787787048.154312:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787787048.154364:0:6549:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787787048.154435:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c3d330 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6549:1874630503564544:0@lo:502: 00000100:00100000:1.0:1787787048.154513:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787048.154723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564544 00000100:00100000:3.0:1787787048.154730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564544 00000100:00100000:1.0:1787787048.155302:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ae784d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787787048.160256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787048.160277:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078789cc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+9:6549:x1874630503564544:12345-0@lo:502: 00000100:00100000:0.0:1787787048.160488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078789cc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+9:6549:x1874630503564544:12345-0@lo:502: Request processed in 220us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787048.160496:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787048.161063:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c3d330 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6549:1874630503564544:0@lo:502: 00000020:01000000:1.0:1787787048.161115:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787048.161123:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787048.161126:0:6549:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787787048.161161:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787787048.161740:0:6504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787787048.161765:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787787048.161799:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.161812:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787048.161828:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c3240800 from 1 10000000:01000000:2.0:1787787048.161830:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787048.162043:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.162111:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.162157:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787048.162179:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b908f14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564672:0@lo:101: 00000100:00100000:2.0:1787787048.162234:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787048.162282:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec9795da going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.163113:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564672 00000100:00100000:1.0:1787787048.163122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564672 00000100:00100000:1.0:1787787048.163178:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787048.163186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008209ded1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+9:6504:x1874630503564672:12345-0@lo:101: 00010000:00010000:1.0:1787787048.163200:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787048.163216:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8895 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.163239:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.163250:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.163258:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca48ad83, rc 0) 00000100:00100000:1.0:1787787048.163324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008209ded1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+10:6504:x1874630503564672:12345-0@lo:101: Request processed in 139us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.163332:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787048.163386:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b908f14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564672:0@lo:101: 00010000:00010000:3.0:1787787048.163402:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787048.163440:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787048.168636:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ba04dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564800:0@lo:256: 00000100:00100000:2.0:1787787048.168716:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787048.168762:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d2406f3 going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.168780:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564800 00000100:00100000:1.0:1787787048.168789:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564800 00000100:00100000:1.0:1787787048.168853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787048.168860:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091619a56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+10:6504:x1874630503564800:12345-0@lo:256: 20000000:01000000:1.0:1787787048.168881:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787787048.168886:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787787048.168959:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091619a56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+10:6504:x1874630503564800:12345-0@lo:256: Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.168966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787048.169011:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ba04dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564800:0@lo:256: 10000000:01000000:2.0:1787787048.172106:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787048.172134:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.172162:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787048.172171:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3240800 from 1 10000000:01000000:2.0:1787787048.172174:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787048.172215:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.172223:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.172234:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787048.172271:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564928:0@lo:101: 00000100:00100000:2.0:1787787048.172344:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787048.172373:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503564928 00000100:00100000:2.0:1787787048.172384:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d2406f3 going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.172388:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503564928 00000100:00100000:1.0:1787787048.172445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787048.172453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000238c742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+10:6504:x1874630503564928:12345-0@lo:101: 00010000:00010000:1.0:1787787048.172467:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787048.172479:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a88a3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.172504:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.172514:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.172523:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d0be694, rc 0) 00000100:00100000:1.0:1787787048.172559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000238c742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+11:6504:x1874630503564928:12345-0@lo:101: Request processed in 108us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.172566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787048.173502:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503564928:0@lo:101: 00010000:00010000:2.0:1787787048.173520:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.173529:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787048.173610:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565056:0@lo:501: 00000100:00100000:2.0:1787787048.173657:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787048.173690:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d2406f3 going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.173815:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565056 00000100:00100000:1.0:1787787048.173822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565056 00000100:00100000:1.0:1787787048.173869:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787048.173877:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e58a49d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+11:6504:x1874630503565056:12345-0@lo:501: 00000100:00100000:1.0:1787787048.174045:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e58a49d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+11:6504:x1874630503565056:12345-0@lo:501: Request processed in 169us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.174053:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787787048.174362:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565056:0@lo:501: 00000100:00100000:2.0:1787787048.174393:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565184:0@lo:503: 00000100:00100000:2.0:1787787048.174449:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787048.174526:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d2406f3 going to sleep for 11 seconds 00000100:00100000:0.0:1787787048.176034:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565184 00000100:00100000:0.0:1787787048.176059:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565184 00000100:00100000:0.0:1787787048.176224:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787048.176233:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f5d68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+11:6504:x1874630503565184:12345-0@lo:503: 00000040:00080000:0.0:1787787048.176285:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787048.176363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f5d68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+11:6504:x1874630503565184:12345-0@lo:503: Request processed in 131us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787048.176371:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787048.176479:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565184:0@lo:503: 00000040:00080000:0.0:1787787048.178506:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787787048.178775:0:6504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787787048.178800:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787048.178818:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787048.178829:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787048.178879:0:6504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787787048.178882:0:6504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870c3240800 10000000:01000000:3.0:1787787048.178885:0:6504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870c3240800 10000000:01000000:3.0:1787787048.178889:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787048.178895:0:6504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c3240800 from 1 10000000:01000000:3.0:1787787048.178897:0:6504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787048.178930:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787048.178938:0:6504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787048.178947:0:6504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787048.178970:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c72682bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565312:0@lo:101: 00000100:00100000:3.0:1787787048.179046:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787048.179091:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093420000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.179127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565312 00000100:00100000:1.0:1787787048.179136:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565312 00000100:00100000:1.0:1787787048.179217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787048.179225:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017206108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+11:6504:x1874630503565312:12345-0@lo:101: 00010000:00010000:1.0:1787787048.179241:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787048.179260:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a88b1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.179284:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.179294:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.179303:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081a8ab4a, rc 0) 00000100:00100000:1.0:1787787048.179357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017206108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503565312:12345-0@lo:101: Request processed in 132us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.179363:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787048.180653:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c72682bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565312:0@lo:101: 00010000:00010000:0.0:1787787048.180677:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787048.180688:0:6504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787048.180760:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565440:0@lo:501: 00000100:00100000:0.0:1787787048.180807:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787048.180836:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001df9e243 going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.180898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565440 00000100:00100000:1.0:1787787048.180904:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565440 00000100:00100000:1.0:1787787048.180947:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787048.180955:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5761907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503565440:12345-0@lo:501: 00000100:00100000:1.0:1787787048.181088:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5761907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503565440:12345-0@lo:501: Request processed in 133us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.181106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787048.181416:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565440:0@lo:501: 00000100:00100000:0.0:1787787048.181515:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565568:0@lo:503: 00000100:00100000:0.0:1787787048.181561:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787048.181623:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 000000001df9e243 going to sleep for 11 seconds 00000100:00100000:3.0:1787787048.184743:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565568 00000100:00100000:3.0:1787787048.184757:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565568 00000100:00100000:3.0:1787787048.184813:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787048.184821:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc538ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503565568:12345-0@lo:503: 00000100:00100000:3.0:1787787048.185171:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc538ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503565568:12345-0@lo:503: Request processed in 350us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787048.185180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787048.185334:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503565568:0@lo:503: 00000100:00100000:1.0:1787787048.185914:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c3d330 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6554:1874630503565696:0@lo:502: 00000100:00100000:1.0:1787787048.185965:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787048.186007:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c27c1cfb going to sleep for 11 seconds 00000100:00100000:3.0:1787787048.186268:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565696 00000100:00100000:3.0:1787787048.186274:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565696 00000100:00100000:3.0:1787787048.186305:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787048.186312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b41b54de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:6554:x1874630503565696:12345-0@lo:502: 00000100:00100000:3.0:1787787048.186403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b41b54de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:6554:x1874630503565696:12345-0@lo:502: Request processed in 91us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787048.186410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787048.186525:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c3d330 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6554:1874630503565696:0@lo:502: 00000020:01000004:2.0:1787787048.186585:0:6554:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787787048.186609:0:6554:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d18a8805) 00000020:00000080:2.0:1787787048.186628:0:6554:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787787048.186705:0:6554:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b2bc8eee from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787787048.186709:0:6554:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b2bc8eee from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787787048.186717:0:6554:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b2bc8eee 4 00010000:00080000:2.0:1787787048.186742:0:6554:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000016018cc0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:2.0:1787787048.191400:0:6554:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787787048.191665:0:6554:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787787048.191707:0:6554:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787048.191719:0:6554:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x11620bc3f30a88c6 00000100:00080000:2.0:1787787048.191729:0:6554:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787048.191734:0:6554:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000016018cc0 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787048.191767:0:6554:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e207a15e x1874630503565824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787048.191799:0:6554:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787787048.193550:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503565824:0@lo:38: 00000100:00100000:1.0:1787787048.193625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787048.196243:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565824 00000100:00100000:0.0:1787787048.196257:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565824 00000100:00100000:0.0:1787787048.197453:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787048.197463:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ece9d51b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503565824:12345-0@lo:38: 00000100:00100000:0.0:1787787048.197571:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ece9d51b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503565824:12345-0@lo:38: Request processed in 107us (3946us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787787048.197579:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787048.198623:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787048.198634:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000016018cc0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787048.198640:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787787048.198652:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503565824:0@lo:38: 00000100:00100000:3.0:1787787048.199010:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c72682bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6554:1874630503565952:0@lo:502: 00000100:00100000:3.0:1787787048.199085:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787048.199155:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f12dfffa going to sleep for 11 seconds 00000100:00100000:0.0:1787787048.199360:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503565952 00000100:00100000:0.0:1787787048.199367:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503565952 00000100:00100000:0.0:1787787048.199408:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787048.199982:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008715d8da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:6554:x1874630503565952:12345-0@lo:502: 00000100:00100000:0.0:1787787048.200308:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008715d8da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:6554:x1874630503565952:12345-0@lo:502: Request processed in 891us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787048.200317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787048.200449:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c72682bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:6554:1874630503565952:0@lo:502: 00000040:00080000:3.0:1787787048.200583:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787787048.200744:0:6504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787787048.200764:0:6504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787048.200786:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787048.200797:0:6504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787048.200845:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787048.200847:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787048.200849:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787048.200850:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787048.200851:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787048.200853:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787048.200854:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787048.200856:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787048.200857:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787048.200858:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787048.200860:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787048.200861:0:6504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787048.200865:0:6504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787787048.200867:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787048.200872:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787048.200873:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787048.200874:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787048.200875:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787048.200876:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787048.200877:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787048.200878:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787048.200879:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787048.200880:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787048.200881:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787048.200881:0:6504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787048.200899:0:6504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787787048.200910:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503566080:0@lo:253: 00000100:00100000:0.0:1787787048.200949:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787048.200975:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ead92f92 going to sleep for 11 seconds 00000100:00100000:0.0:1787787048.201216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566080 00000100:00100000:0.0:1787787048.201222:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566080 00000100:00100000:0.0:1787787048.201258:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787787048.201266:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f1ada74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503566080:12345-0@lo:253: 20000000:01000000:0.0:1787787048.201288:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787787048.201301:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787787048.214541:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787787048.214590:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787787048.214931:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f1ada74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:6504:x1874630503566080:12345-0@lo:253: Request processed in 13661us (13978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787048.214944:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787048.215108:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:6504:1874630503566080:0@lo:253: 10000000:01000000:3.0:1787787048.215123:0:6504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787787048.215126:0:6504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787048.215128:0:6504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787048.215129:0:6504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787048.215131:0:6504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787048.215132:0:6504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787048.215133:0:6504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787048.215135:0:6504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787048.215153:0:6504:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787048.215169:0:6504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787048.215171:0:6504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787048.215172:0:6504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787048.215174:0:6504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787048.215188:0:6504:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787787048.220404:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787048.220417:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787048.220451:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.220472:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.220480:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.220530:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787048.220549:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 11 pid: 6522 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787048.220562:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067734e90 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503566208:0@lo:104: 00000100:00100000:2.0:1787787048.220763:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787048.220851:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c694759a going to sleep for 11 seconds 00000100:00100000:1.0:1787787048.220899:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566208 00000100:00100000:1.0:1787787048.220908:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566208 00000100:00100000:1.0:1787787048.220966:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787048.220985:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000309dabf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503566208:12345-0@lo:104: 00010000:00010000:1.0:1787787048.220998:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.221064:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787048.221069:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000309dabf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503566208:12345-0@lo:104: Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.221077:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787787048.221106:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787048.221111:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.221119:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc245523 already unused, calling callback (0000000059df79fd) 10000000:00010000:1.0:1787787048.221123:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.221130:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787048.221320:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067734e90 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503566208:0@lo:104: 00010000:00010000:0.0:1787787048.221343:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787048.221435:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787048.221442:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787048.221477:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.221494:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787048.221681:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.221689:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000fc245523/0x11620bc3f30a8895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a889c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.221706:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787048.221708:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787048.221710:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787048.221741:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787048.221752:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd9995 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503566336:0@lo:103: 00000100:00100000:2.0:1787787048.221787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787048.222087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566336 00000100:00100000:1.0:1787787048.222092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566336 00010000:00010000:1.0:1787787048.222123:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 12 pid: 6522 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787048.222176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787048.222183:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e148608 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+12:3653:x1874630503566336:12345-0@lo:103: 00010000:00010000:1.0:1787787048.222194:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787048.222198:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 12 pid: 6522 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222207:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 12 pid: 6522 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222220:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca48ad83/0x11620bc3f30a889c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8895 expref: 12 pid: 6522 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222233:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222415:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787048.222444:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002028540s 00010000:00010000:1.0:1787787048.222448:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222454:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222460:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222466:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222471:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d8d91c37 already unused, calling callback (00000000edbd5163) 00010000:00010000:1.0:1787787048.222474:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222481:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222643:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787048.222655:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787048.222701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e148608 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+11:3653:x1874630503566336:12345-0@lo:103: Request processed in 519us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787048.222709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787048.222725:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd9995 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503566336:0@lo:103: 00010000:00010000:0.0:1787787048.224914:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787048.224948:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787048.224954:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d8d91c37/0x11620bc3f30a88cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787787048.226496:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1787787048.226728:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787787048.228755:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1787787048.228921:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787787048.229131:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1787787048.229309:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787787048.235390:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1787787048.235603:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787787048.235790:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787787048.235948:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787787048.236176:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787787048.236340:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787787048.245403:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787787048.275407:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787787048.275627:0:6559:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787787048.275632:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787787048.275994:0:6560:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787787048.283066:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787787048.283215:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787787048.288245:0:6504:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787787048.288269:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787787048.289465:0:6560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787048.291939:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787048.295052:0:6504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787787048.295661:0:6504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787787048.295695:0:6504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787787048.295942:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787787048.296207:0:6504:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1787787048.313717:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787787048.314075:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787787048.314264:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787787048.314412:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787787048.314554:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787787048.314671:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000040:00080000:0.0:1787787048.314759:0:6560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1787787048.314817:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000004:00080000:0.0:1787787048.314837:0:6560:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787787048.314842:0:6560:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1787787048.314955:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787787048.315083:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787787048.315246:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787787048.315412:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787787048.315559:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787787048.315726:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787787048.315849:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787787048.316002:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787787048.316125:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787787048.319022:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787787048.320030:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787787048.320371:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787787048.320597:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787787048.320778:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787787048.321045:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787787048.321409:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787787048.322172:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787787048.322314:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787787048.322831:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787787048.322971:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787787048.323105:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787787048.323392:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787787048.323642:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787787048.323783:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787787048.324034:0:6504:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787787048.324377:0:6504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1787787048.328626:0:6504:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787787048.328672:0:6504:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa622416eb988 00100000:10000000:1.0:1787787048.328692:0:6504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787787048.329570:0:6504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787048.329586:0:6504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787048.329605:0:6504:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787787048.329642:0:6504:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787787048.330451:0:6504:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787048.330645:0:6504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787787048.746469:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787049.769334:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787050.801561:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787051.817489:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787052.757346:0:6805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787787052.841330:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787053.421285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787787053.421297:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787787053.421300:0:8:0:(import.c:65:import_set_state_nolock()) 0000000016018cc0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787053.421314:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000016018cc0 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787053.421347:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001a67fc53 x1874630503566592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787053.421395:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a67fc53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503566592:0@lo:38: 00000100:00100000:2.0:1787787053.421466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787053.421550:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566592 00000100:00100000:2.0:1787787053.421557:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566592 00000100:00100000:2.0:1787787053.421587:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787053.421593:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056dea6cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503566592:12345-0@lo:38: 00010000:00080000:2.0:1787787053.421616:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1787787053.421650:0:6529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x11620bc3f30a88d4 00000100:00100000:0.0:1787787053.421926:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d549884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503566464:0@lo:400: 00000100:00100000:0.0:1787787053.421963:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787053.422154:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566464 00000100:00100000:0.0:1787787053.422165:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566464 00000100:00100000:0.0:1787787053.422200:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787787053.422206:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008633743b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+11:3655:x1874630503566464:12345-0@lo:400: 00000100:00100000:0.0:1787787053.422251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008633743b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+11:3655:x1874630503566464:12345-0@lo:400: Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787053.422258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787787053.422303:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d549884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503566464:0@lo:400: 00000004:00100000:2.0:1787787053.422564:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787053.422711:0:6529:0:(import.c:65:import_set_state_nolock()) 00000000480bb718 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787053.422941:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056dea6cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874630503566592:12345-0@lo:38: Request processed in 1347us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787053.422949:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787787053.422998:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001a67fc53 x1874630503566592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787053.423026:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787787053.423033:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787787053.423037:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787053.423040:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000016018cc0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787053.423044:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a67fc53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503566592:0@lo:38: 00000020:00000004:2.0:1787787053.538929:0:6857:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787053.539356:0:6857:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787787053.865425:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787054.890278:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787787054.954671:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787054.954679:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c3240800 from 3 10000000:01000000:2.0:1787787054.954685:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787054.954732:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787054.954744:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787054.954755:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787054.954777:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5759249 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503566720:0@lo:101: 00000100:00100000:2.0:1787787054.954847:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787054.954918:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a08a308 going to sleep for 11 seconds 00000100:00100000:0.0:1787787054.955093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566720 00000100:00100000:0.0:1787787054.955102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566720 00000100:00100000:0.0:1787787054.955177:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787054.955185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dee5f8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+11:6524:x1874630503566720:12345-0@lo:101: 00010000:00010000:0.0:1787787054.955198:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787054.955211:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a88db expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787054.955233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a88db expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787054.955244:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88db expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787054.955252:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039650035, rc 0) 00000100:00100000:0.0:1787787054.955310:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dee5f8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:6524:x1874630503566720:12345-0@lo:101: Request processed in 127us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787054.955317:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787054.956677:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5759249 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503566720:0@lo:101: 00010000:00010000:2.0:1787787054.956699:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787054.956710:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787054.956785:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5759249 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503566848:0@lo:256: 00000100:00100000:2.0:1787787054.956838:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787054.956878:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a08a308 going to sleep for 11 seconds 00000100:00100000:0.0:1787787054.956996:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566848 00000100:00100000:0.0:1787787054.957002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566848 00000100:00100000:0.0:1787787054.957052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787054.957058:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e13802 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:6524:x1874630503566848:12345-0@lo:256: 20000000:01000000:0.0:1787787054.957074:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787787054.957086:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787787054.957089:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787787054.957206:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e13802 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:6524:x1874630503566848:12345-0@lo:256: Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787054.957214:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787054.957995:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5759249 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503566848:0@lo:256: 10000000:01000000:2.0:1787787054.958048:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787054.958056:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787054.958064:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787055.913751:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787787056.309186:0:6959:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787056.309373:0:6959:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787056.942473:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787057.961468:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787058.537565:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a6b7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503567104:0@lo:400: 00000100:00100000:3.0:1787787058.537610:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787058.537624:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f375f407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503566976:0@lo:400: 00000100:00100000:3.0:1787787058.537686:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787058.537741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787058.537784:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503566976 00000100:00100000:0.0:1787787058.537791:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503566976 00000100:00100000:0.0:1787787058.537868:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787058.537877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000259e75a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:3655:x1874630503566976:12345-0@lo:400: 00000100:00100000:0.0:1787787058.537928:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000259e75a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:3655:x1874630503566976:12345-0@lo:400: Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787058.537935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787058.537946:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567104 00000100:00100000:1.0:1787787058.537951:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567104 00000100:00100000:1.0:1787787058.537982:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787058.537988:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a67fc53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503567104:12345-0@lo:400: 00000100:00100000:3.0:1787787058.538002:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f375f407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503566976:0@lo:400: 00000100:00100000:1.0:1787787058.538028:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a67fc53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503567104:12345-0@lo:400: Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787058.538034:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787787058.538088:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054a6b7bb x1874630503567104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787058.538101:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a6b7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503567104:0@lo:400: 00010000:00010000:1.0:1787787058.985548:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787060.011306:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787061.033559:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787062.057235:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787063.086298:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787063.661644:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004226a608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503567232:0@lo:400: 00000100:00100000:2.0:1787787063.661725:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787063.663646:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787063.663665:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503567360:0@lo:400: 00000100:00100000:1.0:1787787063.663733:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787063.664454:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567360 00000100:00100000:2.0:1787787063.664463:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567360 00000100:00100000:2.0:1787787063.664520:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787063.664529:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076b57c3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503567360:12345-0@lo:400: 00000100:00100000:2.0:1787787063.664599:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076b57c3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503567360:12345-0@lo:400: Request processed in 72us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787063.664607:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787787063.664705:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000d842920 x1874630503567360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787063.664720:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503567360:0@lo:400: 00000100:00100000:0.0:1787787063.666547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567232 00000100:00100000:0.0:1787787063.666561:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567232 00000100:00100000:2.0:1787787063.666753:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787063.666763:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010b2f996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:3654:x1874630503567232:12345-0@lo:400: 00000100:00100000:2.0:1787787063.666882:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010b2f996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:3654:x1874630503567232:12345-0@lo:400: Request processed in 121us (5158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787063.666889:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787063.666986:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004226a608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503567232:0@lo:400: 00010000:00010000:2.0:1787787064.108836:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787065.132528:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787787065.941103:0:7457:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787787065.941108:0:7457:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787787065.941109:0:7457:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787787065.941343:0:7457:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000041f3c774 00000020:01000004:2.0:1787787065.941360:0:7457:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787787065.941375:0:7457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787787065.941387:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000012d1fe03) 00000020:00000080:2.0:1787787065.941401:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787787065.998806:0:7457:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787787065.998887:0:7457:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787787066.019984:0:7457:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787787066.020417:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787787066.022534:0:7457:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787787066.022555:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a88f0 00000020:01000004:3.0:1787787066.022564:0:7457:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787787066.022589:0:7457:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787787066.022592:0:7457:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787787066.022599:0:7457:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787787066.022640:0:7457:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787787066.022645:0:7457:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787787066.038908:0:7457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787066.038948:0:7457:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.131@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787787066.038952:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787066.038953:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787066.038959:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787066.038960:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787066.038961:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787066.038962:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787066.038963:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787066.038964:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787066.038966:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787066.038967:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787066.038968:0:7457:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787066.038971:0:7457:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787787066.038973:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787066.038974:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787066.038975:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787066.038975:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787066.038976:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787066.038977:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787066.038978:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787066.038978:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787066.038979:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787066.038980:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787066.038980:0:7457:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787066.039005:0:7457:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787787066.039021:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6667aac pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503567488:0@lo:253: 00000100:00100000:3.0:1787787066.039104:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.039294:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fb63e32 going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.039341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567488 00000100:00100000:0.0:1787787066.039349:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567488 00000100:00100000:0.0:1787787066.039431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787066.039440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a239916e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503567488:12345-0@lo:253: 20000000:01000000:0.0:1787787066.039475:0:6522:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787787066.039479:0:6522:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787787066.039484:0:6522:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787787066.039487:0:6522:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787787066.039514:0:6522:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787787066.039692:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787066.039803:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787787066.039816:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787787066.039832:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787787066.039845:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787787066.039857:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787787066.039900:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787787066.039907:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787787066.039918:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787787066.039923:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787787066.039936:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787787066.039941:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787787066.039951:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787787066.039963:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787787066.040049:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787787066.040057:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:0.0:1787787066.040069:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787787066.040074:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787787066.040100:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787787066.040105:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:0.0:1787787066.040114:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787787066.040118:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787787066.040129:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787787066.040292:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787787066.040305:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787787066.040378:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787787066.040386:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787787066.040397:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787787066.040412:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787787066.040426:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787787066.040431:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787787066.040440:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787787066.040471:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787787066.040476:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787787066.040494:0:6522:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787787066.040501:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787787066.040978:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787787066.041638:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787787066.041663:0:6522:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.131@tcp for mdt 20000000:01000000:0.0:1787787066.041665:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:0.0:1787787066.041682:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787787066.041688:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787787066.041704:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787787066.041709:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:0.0:1787787066.041725:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787787066.041733:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787787066.041747:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787787066.041762:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787787066.041809:0:6522:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787787066.041818:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787787066.042246:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787787066.042400:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787787066.042415:0:6522:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.131@tcp for mdt 20000000:01000000:3.0:1787787066.042417:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787787066.042431:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787787066.042438:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787787066.042451:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787787066.042457:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:3.0:1787787066.042466:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787787066.042471:0:6522:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787787066.042481:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787787066.042493:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787787066.042516:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787787066.042519:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787787066.042522:0:6522:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787787066.042570:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787787066.042573:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787066.042879:0:7465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787066.042899:0:7465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787066.042911:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787787066.043028:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787787066.043044:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787787066.043055:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787787066.043063:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787787066.043065:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787066.043508:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787066.043525:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787066.043537:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787787066.043715:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787787066.043733:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787787066.043750:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787787066.043760:0:6522:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787787066.043762:0:6522:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787066.044003:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787066.044019:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787066.044031:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787787066.044311:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787787066.044331:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787787066.044348:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787787066.044361:0:6522:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787787066.044363:0:6522:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787787066.044367:0:6522:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787787066.044372:0:6522:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787787066.044909:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1787787066.045032:0:6522:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787787066.054537:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787787066.054696:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054718:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054726:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054732:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054760:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054802:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054818:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 12 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787066.054832:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874630503567616:0@lo:104: 00000100:00100000:2.0:1787787066.054896:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787066.054956:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.054964:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 12 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787066.054973:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874630503567744:0@lo:104: 00000100:00100000:2.0:1787787066.054996:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787066.055029:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.055036:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 12 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787066.055043:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d549884 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874630503567872:0@lo:104: 00000100:00100000:2.0:1787787066.055063:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787066.055073:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d8c5117 going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.055172:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567616 00000100:00100000:0.0:1787787066.055180:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567616 00000100:00100000:0.0:1787787066.055221:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567744 00000100:00100000:0.0:1787787066.055231:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567744 00000100:00100000:0.0:1787787066.055246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503567872 00000100:00100000:0.0:1787787066.055249:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503567872 00000100:00100000:0.0:1787787066.055263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787066.055270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b908f14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+5:6522:x1874630503567616:12345-0@lo:104: 00010000:00010000:0.0:1787787066.055281:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055341:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787066.055346:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b908f14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+5:6522:x1874630503567616:12345-0@lo:104: Request processed in 77us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.055354:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787066.055370:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787066.055376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5a6c90d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:6522:x1874630503567744:12345-0@lo:104: 00010000:00010000:0.0:1787787066.055382:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055415:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787066.055419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5a6c90d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:6522:x1874630503567744:12345-0@lo:104: Request processed in 45us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.055425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787066.055436:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787066.055441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5759249 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6522:x1874630503567872:12345-0@lo:104: 00010000:00010000:0.0:1787787066.055448:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055473:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787787066.055477:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5759249 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6522:x1874630503567872:12345-0@lo:104: Request processed in 37us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.055490:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787787066.055508:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787787066.055514:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055521:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000839d961a already unused, calling callback (0000000059df79fd) 10000000:00010000:0.0:1787787066.055524:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055532:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787066.055538:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.055544:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787066.055572:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055579:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787066.055596:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055603:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000839d961a/0x11620bc3f30a88b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055615:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787066.055616:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055631:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000279d2b00 already unused, calling callback (0000000059df79fd) 10000000:00010000:0.0:1787787066.055633:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055638:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787066.055644:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.055648:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787066.055661:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055667:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787066.055680:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055686:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000279d2b00/0x11620bc3f30a8841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8848 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055694:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787066.055695:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055700:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000970d7fb4 already unused, calling callback (0000000059df79fd) 10000000:00010000:0.0:1787787066.055702:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055717:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787066.055722:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.055726:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787066.055738:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055743:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787066.055747:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055752:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000970d7fb4/0x11620bc3f30a8825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a882c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.055765:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787066.055766:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787066.055767:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787066.055773:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787066.055789:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060e814d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503568000:0@lo:103: 00000100:00100000:0.0:1787787066.055818:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.055852:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503568128:0@lo:103: 00000100:00100000:0.0:1787787066.055873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.055893:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787066.055898:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503568256:0@lo:103: 00000100:00100000:0.0:1787787066.055915:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.055952:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568000 00000100:00100000:0.0:1787787066.055955:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568000 00010000:00010000:0.0:1787787066.055971:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 13 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.055985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568128 00000100:00100000:0.0:1787787066.055987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568128 00010000:00010000:0.0:1787787066.055994:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 14 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.056002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568256 00000100:00100000:0.0:1787787066.056004:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568256 00010000:00010000:0.0:1787787066.056012:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 15 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.056022:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787066.056026:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000017ee127 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+15:3656:x1874630503568000:12345-0@lo:103: 00010000:00010000:0.0:1787787066.056036:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787066.056039:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 15 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056049:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 15 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056065:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787066.056103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000017ee127 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+15:3656:x1874630503568000:12345-0@lo:103: Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.056110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787066.056123:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787066.056129:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015c7aaef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+14:3653:x1874630503568128:12345-0@lo:103: 00010000:00010000:0.0:1787787066.056135:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787066.056165:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 14 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056174:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 14 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056183:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787066.056208:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015c7aaef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+14:3653:x1874630503568128:12345-0@lo:103: Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.056214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787066.056225:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787066.056230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3659368 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+13:3653:x1874630503568256:12345-0@lo:103: 00010000:00010000:0.0:1787787066.056237:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787066.056240:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 13 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056248:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 13 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056258:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056264:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056275:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056282:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056287:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056302:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056307:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc1f1809 already unused, calling callback (00000000edbd5163) 00010000:00010000:0.0:1787787066.056310:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056317:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056324:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.056334:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787066.056355:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3659368 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+13:3653:x1874630503568256:12345-0@lo:103: Request processed in 124us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.056361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787066.056399:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060e814d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503568000:0@lo:103: 00000100:00100000:0.0:1787787066.056422:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503568256:0@lo:103: 00000100:00100000:0.0:1787787066.056429:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503568128:0@lo:103: 00010000:00010000:3.0:1787787066.057307:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081a8ab4a/0x11620bc3f30a88b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a88b1 expref: 12 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.057322:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e207a15e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874630503567616:0@lo:104: 00010000:00010000:3.0:1787787066.057331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073d36be4/0x11620bc3f30a8848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8841 expref: 11 pid: 6522 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.057350:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874630503567744:0@lo:104: 00010000:00010000:3.0:1787787066.057361:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f371fe50/0x11620bc3f30a882c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8825 expref: 10 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.057371:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d549884 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6522:1874630503567872:0@lo:104: 00010000:00010000:3.0:1787787066.057390:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.057398:0:6522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.057403:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.057408:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc1f1809/0x11620bc3f30a88f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787066.057424:0:6522:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787787066.059045:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a239916e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+9:7457:x1874630503567488:12345-0@lo:253: Request processed in 19600us (19935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.059058:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787066.059186:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6667aac pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503567488:0@lo:253: 10000000:01000000:0.0:1787787066.059201:0:7457:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787787066.059203:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787066.059205:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787787066.059207:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787066.059208:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787787066.059209:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787066.059220:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787066.059221:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787066.059223:0:7457:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787787066.059224:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787066.059226:0:7457:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787066.059249:0:7457:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000041f3c774 from lustre-MDT0001 10000000:01000000:0.0:1787787066.059278:0:7457:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787787066.059281:0:7457:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787787066.059287:0:7457:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9870d15599b8 local copy 10000000:01000000:0.0:1787787066.059291:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787066.059323:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.059332:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.059341:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.059358:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568384:0@lo:101: 00000100:00100000:0.0:1787787066.059392:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.059424:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a0f030d going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.059480:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568384 00000100:00100000:3.0:1787787066.059486:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568384 00000100:00100000:3.0:1787787066.059529:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787066.059536:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df937da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+9:7457:x1874630503568384:12345-0@lo:101: 00010000:00010000:3.0:1787787066.059548:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787066.059559:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000541a6a9a/0x11620bc3f30a8905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a88fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.059590:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000541a6a9a/0x11620bc3f30a8905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a88fe expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.059599:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000541a6a9a/0x11620bc3f30a8905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88fe expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.059608:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000541a6a9a, rc 0) 00000100:00100000:3.0:1787787066.059635:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df937da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+10:7457:x1874630503568384:12345-0@lo:101: Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.059641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787066.059762:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568384:0@lo:101: 00010000:00010000:0.0:1787787066.059774:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.059782:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.059888:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568512:0@lo:501: 00000100:00100000:0.0:1787787066.059915:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.059946:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a0f030d going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.059988:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568512 00000100:00100000:3.0:1787787066.059993:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568512 00000100:00100000:3.0:1787787066.060023:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787787066.060029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b27403e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+10:7457:x1874630503568512:12345-0@lo:501: 00000100:00100000:3.0:1787787066.060095:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b27403e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+10:7457:x1874630503568512:12345-0@lo:501: Request processed in 67us (180us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787066.060103:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787066.060247:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568512:0@lo:501: 10000000:01000000:0.0:1787787066.060259:0:7457:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787787066.060276:0:7457:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787787066.060280:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060287:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060293:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060318:0:7457:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787787066.060341:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870d2373000 10000000:01000000:0.0:1787787066.060346:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787787066.060351:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9870d15599b8 10000000:01000000:0.0:1787787066.060353:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787787066.060357:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9870d15599b8 from 1 10000000:01000000:0.0:1787787066.060359:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787787066.060374:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060381:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060387:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.060398:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568640:0@lo:101: 00000100:00100000:0.0:1787787066.060431:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.060453:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568640 00000100:00100000:0.0:1787787066.060457:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568640 00000100:00100000:0.0:1787787066.060478:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787066.060484:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc381a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+10:7457:x1874630503568640:12345-0@lo:101: 00010000:00010000:0.0:1787787066.060491:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787066.060500:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028ec4075/0x11620bc3f30a8913 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a890c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060514:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028ec4075/0x11620bc3f30a8913 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a890c expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060521:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028ec4075/0x11620bc3f30a8913 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a890c expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060527:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028ec4075, rc 0) 00000100:00100000:0.0:1787787066.060550:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc381a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+11:7457:x1874630503568640:12345-0@lo:101: Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.060556:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787066.060575:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fca997bb going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.060586:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568640:0@lo:101: 00010000:00010000:0.0:1787787066.060595:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060602:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.060614:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787787066.060622:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060634:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000566542d5/0x11620bc3f30a890c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.060642:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9870d2373000 10000000:01000000:0.0:1787787066.060656:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787787066.060659:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9870d2373000 from 1 10000000:01000000:0.0:1787787066.060662:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787787066.060673:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060679:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060685:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.060695:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568768:0@lo:101: 00000100:00100000:0.0:1787787066.060717:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.060734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568768 00000100:00100000:0.0:1787787066.060737:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568768 00000100:00100000:0.0:1787787066.060754:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787066.060759:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a86969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+11:7457:x1874630503568768:12345-0@lo:101: 00010000:00010000:0.0:1787787066.060765:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787066.060771:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017c7ed00/0x11620bc3f30a8921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a891a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060783:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017c7ed00/0x11620bc3f30a8921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a891a expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060800:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017c7ed00/0x11620bc3f30a8921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a891a expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060806:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017c7ed00, rc 0) 00000100:00100000:0.0:1787787066.060828:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a86969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503568768:12345-0@lo:101: Request processed in 68us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.060833:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787066.060855:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fca997bb going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.060865:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568768:0@lo:101: 00010000:00010000:0.0:1787787066.060873:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060878:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.060886:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787787066.060892:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060897:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000c5ec3388/0x11620bc3f30a891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.060902:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787787066.060912:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787066.060916:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9870d2373000 10000000:01000000:0.0:1787787066.060918:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787787066.060920:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787787066.060922:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787787066.060939:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060944:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.060950:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.060959:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568896:0@lo:101: 00000100:00100000:0.0:1787787066.060980:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.060995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503568896 00000100:00100000:0.0:1787787066.060998:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503568896 00000100:00100000:0.0:1787787066.061014:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787066.061018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7bade2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503568896:12345-0@lo:101: 00010000:00010000:0.0:1787787066.061023:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787066.061029:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ae514c3/0x11620bc3f30a892f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8928 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.061039:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ae514c3/0x11620bc3f30a892f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.061045:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ae514c3/0x11620bc3f30a892f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.061050:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ae514c3, rc 0) 00000100:00100000:0.0:1787787066.061068:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7bade2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:7457:x1874630503568896:12345-0@lo:101: Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.061073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787066.061108:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fca997bb going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.061127:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503568896:0@lo:101: 00010000:00010000:3.0:1787787066.061226:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787066.061231:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.061240:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001623d64d already unused, calling callback (0000000059df79fd) 10000000:00010000:3.0:1787787066.061242:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.061249:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787066.061265:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787066.061270:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787066.061289:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.061294:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787066.061310:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.061316:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 000000001623d64d/0x11620bc3f30a88fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8905 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.061328:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787066.061329:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787066.061331:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787066.061340:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503569024:0@lo:103: 00000100:00100000:3.0:1787787066.061367:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.061405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569024 00000100:00100000:3.0:1787787066.061409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569024 00000100:00100000:3.0:1787787066.061437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787066.061443:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7c3120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+13:3655:x1874630503569024:12345-0@lo:103: 00010000:00010000:3.0:1787787066.061451:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787066.061462:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000541a6a9a/0x11620bc3f30a8905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a88fe expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.061471:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787066.061505:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7c3120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+12:3655:x1874630503569024:12345-0@lo:103: Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.061511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787066.061537:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503569024:0@lo:103: 00010000:00010000:0.0:1787787066.062570:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.062580:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.062975:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569152:0@lo:501: 00000100:00100000:0.0:1787787066.063019:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.063101:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fca997bb going to sleep for 11 seconds 00000100:00100000:2.0:1787787066.063320:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569152 00000100:00100000:2.0:1787787066.063339:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569152 00000100:00100000:2.0:1787787066.063413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787066.063422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4501239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569152:12345-0@lo:501: 00000100:00100000:2.0:1787787066.063543:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4501239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569152:12345-0@lo:501: Request processed in 123us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.063550:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787066.063618:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054915a34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569152:0@lo:501: 00000100:00100000:1.0:1787787066.063648:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000520f62d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569280:0@lo:503: 00000100:00100000:1.0:1787787066.063688:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787066.063826:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efccd5f going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.063895:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569280 00000100:00100000:0.0:1787787066.063899:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569280 00000100:00100000:0.0:1787787066.063921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787066.063927:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002277d2d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569280:12345-0@lo:503: 00000100:00100000:0.0:1787787066.064007:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002277d2d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569280:12345-0@lo:503: Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.064014:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787787066.064100:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000520f62d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569280:0@lo:503: 00000040:00080000:1.0:1787787066.064374:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787066.064445:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000520f62d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569408:0@lo:502: 00000100:00100000:1.0:1787787066.064479:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787066.064497:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efccd5f going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.064581:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569408 00000100:00100000:0.0:1787787066.064586:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569408 00000100:00100000:0.0:1787787066.064604:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787066.064609:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfab544e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569408:12345-0@lo:502: 00000100:00100000:0.0:1787787066.064685:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfab544e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569408:12345-0@lo:502: Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.064691:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787787066.064793:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000520f62d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569408:0@lo:502: 00000040:00080000:1.0:1787787066.064983:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787787066.065008:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1787787066.065023:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1787787066.065035:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1787787066.065046:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1787787066.065059:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1787787066.065071:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1787787066.065097:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1787787066.065109:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1787787066.065119:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1787787066.065129:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1787787066.065174:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1787787066.065191:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1787787066.065206:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1787787066.065219:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1787787066.065232:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1787787066.065244:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1787787066.065255:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1787787066.065266:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1787787066.065280:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1787787066.065293:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1787787066.065308:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1787787066.065322:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1787787066.065344:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000520f62d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569536:0@lo:502: 00000100:00100000:1.0:1787787066.065385:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787066.065410:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000006efccd5f going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.065484:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569536 00000100:00100000:0.0:1787787066.065489:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569536 00000100:00100000:0.0:1787787066.065511:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787066.065516:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001808f3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569536:12345-0@lo:502: 00000100:00100000:0.0:1787787066.065589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001808f3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569536:12345-0@lo:502: Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.065596:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787066.065740:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000520f62d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569536:0@lo:502: 00000040:00080000:1.0:1787787066.065786:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1787787066.065793:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1787787066.066339:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787066.066352:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787066.066355:0:7469:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787787066.066360:0:7469:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787787066.066363:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787066.066385:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002c85656f) 00000020:00000080:1.0:1787787066.066405:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787787066.066411:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787787066.066519:0:7469:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787787066.066534:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a893d 00000020:00000080:1.0:1787787066.066729:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787787066.066734:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787066.066737:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787066.066739:0:7469:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787787066.066741:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787066.066745:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787066.066746:0:7469:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787787066.066749:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787066.066756:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000261fcd0) 00000020:00000080:1.0:1787787066.066767:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787787066.066771:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787787066.066773:0:7469:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787787066.066775:0:7469:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787787066.066780:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787787066.066825:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000041f3c774 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787787066.066836:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000007ce04fd9) 00000020:00000080:1.0:1787787066.066844:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787787066.066910:0:7469:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787787066.066916:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a8952 00000020:00000080:1.0:1787787066.067020:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787787066.067031:0:7469:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787787066.067036:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x11620bc3f30a8959 00080000:01000000:1.0:1787787066.067041:0:7469:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787787066.067044:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a8960 00080000:10000000:1.0:1787787066.067757:0:7469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787787066.067878:0:7469:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787787066.146685:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787787066.146953:0:7469:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787787066.155408:0:7469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787787066.155786:0:7469:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1787787066.156585:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787787066.172746:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787787066.172763:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787066.172849:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787066.172853:0:7469:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787787066.172858:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787066.172865:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787066.172867:0:7469:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787787066.172871:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787787066.172876:0:7469:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:00000080:3.0:1787787066.172903:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787066.172940:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000103bffaf) 00000020:00000080:3.0:1787787066.172967:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787787066.172974:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787787066.173094:0:7469:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787787066.173101:0:7469:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787787066.173109:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a896e 00010000:00080000:3.0:1787787066.176428:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052d06b6e@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787066.178209:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787787066.184600:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787066.184617:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787787066.184652:0:7469:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787787066.184688:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a8975 00000100:00080000:2.0:1787787066.184698:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787066.184703:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000052d06b6e using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787066.184739:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000b588e89 x1874630503569664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787066.184772:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b588e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503569664:0@lo:38: 00000100:00100000:2.0:1787787066.184839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787787066.184898:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787787066.184948:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787066.184952:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787066.184954:0:7469:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787787066.184957:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787787066.184960:0:7469:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787787066.184970:0:7469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787066.184973:0:7469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787066.184975:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787787066.184978:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787066.184979:0:7469:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787787066.184982:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787066.184987:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787066.184989:0:7469:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787787066.184993:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787787066.185045:0:7469:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787787066.185061:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787066.185064:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787066.185066:0:7469:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787787066.185068:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787066.185070:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787066.185072:0:7469:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787787066.185087:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787787066.185088:0:7469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787787066.185116:0:7469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787066.185119:0:7469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787066.185120:0:7469:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787787066.185123:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1787787066.185650:0:7457:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1787787066.185686:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787787066.185707:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.185719:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 0000000077dc3a04/0x11620bc3f30a8928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.185727:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870d2373000 from 1 10000000:01000000:0.0:1787787066.185730:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787066.185760:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.185767:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.185779:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.185796:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569792:0@lo:101: 00000100:00100000:0.0:1787787066.185839:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.185868:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bee80e0f going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.185893:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569792 00000100:00100000:0.0:1787787066.185900:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569792 00000100:00100000:0.0:1787787066.185943:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787066.185951:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a80408a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+12:7457:x1874630503569792:12345-0@lo:101: 00010000:00010000:0.0:1787787066.185973:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787066.185985:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a897c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.186008:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a897c expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.186027:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a897c expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.186035:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b7f9a4c, rc 0) 00000100:00100000:0.0:1787787066.186069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a80408a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+13:7457:x1874630503569792:12345-0@lo:101: Request processed in 119us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.186095:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787066.186596:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503569792:0@lo:101: 00010000:00010000:0.0:1787787066.186612:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.186620:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787066.187674:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569664 00000100:00100000:1.0:1787787066.187686:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569664 00000100:00100000:1.0:1787787066.187722:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787066.187728:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d549884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503569664:12345-0@lo:38: 00010000:00080000:1.0:1787787066.187752:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1787787066.187785:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a898a 00000004:00100000:1.0:1787787066.187802:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787787066.187808:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787787066.188353:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570048:0@lo:256: 00000100:00100000:0.0:1787787066.188421:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.188463:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bee80e0f going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.188488:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570048 00000100:00100000:0.0:1787787066.188492:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570048 00000100:00100000:0.0:1787787066.188522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787066.188528:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012872d32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+13:7457:x1874630503570048:12345-0@lo:256: 00000100:00100000:2.0:1787787066.191981:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787066.192009:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503569920:0@lo:400: 00000100:00100000:2.0:1787787066.192102:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787066.192546:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503569920 00000100:00100000:2.0:1787787066.192555:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503569920 00000100:00100000:2.0:1787787066.192668:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787066.192676:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e207a15e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503569920:12345-0@lo:400: 00000100:00100000:2.0:1787787066.192741:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e207a15e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503569920:12345-0@lo:400: Request processed in 66us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.192748:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787787066.192810:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000d842920 x1874630503569920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787066.192825:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503569920:0@lo:400: 20000000:01000000:0.0:1787787066.193115:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787787066.193245:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787787066.193249:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787787066.193334:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012872d32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+13:7457:x1874630503570048:12345-0@lo:256: Request processed in 4807us (4915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.193343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787787066.193497:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570048:0@lo:256: 10000000:01000000:2.0:1787787066.194047:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787066.194072:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.194094:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787066.194102:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870d2373000 from 1 10000000:01000000:2.0:1787787066.194105:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787066.194322:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.194331:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.194340:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787066.194359:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570176:0@lo:101: 00000100:00100000:2.0:1787787066.194400:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787066.194427:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054a997be going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.194510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570176 00000100:00100000:0.0:1787787066.194516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570176 00000100:00100000:0.0:1787787066.194556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787787066.194660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba4fc6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:7457:x1874630503570176:12345-0@lo:101: 00010000:00010000:0.0:1787787066.194672:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787066.194683:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8991 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.194704:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.194714:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.194722:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa7a6457, rc 0) 00000100:00100000:0.0:1787787066.194760:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba4fc6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:7457:x1874630503570176:12345-0@lo:101: Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.194806:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570176:0@lo:101: 00010000:00010000:2.0:1787787066.194819:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787066.194841:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787066.194950:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570304:0@lo:501: 00000100:00100000:2.0:1787787066.194979:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787066.195002:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054a997be going to sleep for 11 seconds 00000100:00080000:2.0:1787787066.197413:0:6532:0:(import.c:65:import_set_state_nolock()) 0000000020bca8cd : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787066.197506:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d549884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503569664:12345-0@lo:38: Request processed in 9775us (12663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.197522:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787066.197650:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787787066.197660:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787787066.197668:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787787066.197674:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787066.197676:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000052d06b6e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787066.197689:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b588e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503569664:0@lo:38: 00000100:00100000:1.0:1787787066.197782:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b588e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503570432:0@lo:41: 00000100:00100000:1.0:1787787066.197826:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.197961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570304 00000100:00100000:3.0:1787787066.197969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570304 00000100:00100000:3.0:1787787066.197998:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787066.198005:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019ae8b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570304:12345-0@lo:501: 00000100:00100000:3.0:1787787066.198150:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019ae8b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570304:12345-0@lo:501: Request processed in 132us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.198158:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787066.198316:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570304:0@lo:501: 00000100:00100000:2.0:1787787066.198350:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570560:0@lo:503: 00000100:00100000:2.0:1787787066.198395:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787066.198417:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054a997be going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.198477:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787787066.198507:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570432 00000100:00100000:0.0:1787787066.198511:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570432 00000100:00100000:0.0:1787787066.198541:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787066.198547:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000520f62d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503570432:12345-0@lo:41: 00000004:00000024:0.0:1787787066.198580:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787787066.198660:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570560 00000100:00100000:3.0:1787787066.198665:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570560 00000100:00100000:3.0:1787787066.198683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787066.198696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5a82125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:7457:x1874630503570560:12345-0@lo:503: 00000040:00080000:3.0:1787787066.198731:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787066.198774:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5a82125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:7457:x1874630503570560:12345-0@lo:503: Request processed in 79us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.198782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787066.198822:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570560:0@lo:503: 00000040:00080000:3.0:1787787066.199094:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787066.199198:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787787066.199273:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787066.199937:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787787066.199980:0:7457:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787787066.200008:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787066.200024:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200036:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787066.200092:0:7457:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787787066.200095:0:7457:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870d2373000 10000000:01000000:3.0:1787787066.200098:0:7457:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870d2373000 10000000:01000000:3.0:1787787066.200102:0:7457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787066.200107:0:7457:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870d2373000 from 1 10000000:01000000:3.0:1787787066.200109:0:7457:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787066.200171:0:7457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200179:0:7457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200199:0:7457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.200221:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570688:0@lo:101: 00000100:00100000:3.0:1787787066.200277:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.200308:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c56c6203 going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.200327:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570688 00000100:00100000:3.0:1787787066.200332:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570688 00000100:00100000:3.0:1787787066.200356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787066.200363:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e208ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:7457:x1874630503570688:12345-0@lo:101: 00010000:00010000:3.0:1787787066.200373:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787066.200385:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073d36be4/0x11620bc3f30a89a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a899f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200407:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073d36be4/0x11620bc3f30a89a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a899f expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200417:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073d36be4/0x11620bc3f30a89a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a899f expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200426:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073d36be4, rc 0) 00000100:00100000:3.0:1787787066.200454:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e208ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570688:12345-0@lo:101: Request processed in 92us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.200460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787066.200498:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570688:0@lo:101: 00010000:00010000:3.0:1787787066.200510:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.200527:0:7457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.200607:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570816:0@lo:501: 00000100:00100000:3.0:1787787066.200631:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.200643:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c56c6203 going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.200655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570816 00000100:00100000:3.0:1787787066.200658:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570816 00000100:00100000:3.0:1787787066.200675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787066.200679:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076dc6524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570816:12345-0@lo:501: 00000100:00100000:3.0:1787787066.200772:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076dc6524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570816:12345-0@lo:501: Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.200779:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787066.200807:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570816:0@lo:501: 00000100:00100000:3.0:1787787066.200830:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570944:0@lo:503: 00000100:00100000:3.0:1787787066.200865:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.200878:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c56c6203 going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.200890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503570944 00000100:00100000:3.0:1787787066.200893:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503570944 00000100:00100000:3.0:1787787066.200911:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787066.200916:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f567c7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570944:12345-0@lo:503: 00000100:00100000:3.0:1787787066.200985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f567c7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503570944:12345-0@lo:503: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.200992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787066.201031:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503570944:0@lo:503: 00000040:00080000:3.0:1787787066.201328:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787066.201383:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503571072:0@lo:502: 00000100:00100000:3.0:1787787066.201417:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.201430:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c56c6203 going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.201442:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571072 00000100:00100000:3.0:1787787066.201445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571072 00000100:00100000:3.0:1787787066.201464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787066.201468:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dd6e229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503571072:12345-0@lo:502: 00000100:00100000:0.0:1787787066.205736:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000520f62d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503570432:12345-0@lo:41: Request processed in 7181us (7901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.205753:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787066.206041:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dd6e229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503571072:12345-0@lo:502: Request processed in 4572us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.206050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787066.206288:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cd64d04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503571072:0@lo:502: 00000040:00080000:0.0:1787787066.206581:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787787066.206613:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787787066.206627:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787787066.206643:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787787066.206656:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787787066.206671:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787787066.206685:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787787066.206698:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787787066.206711:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787787066.206724:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787787066.206735:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787787066.206747:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787787066.206759:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787787066.206770:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787787066.206781:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787787066.206809:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787787066.206824:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787787066.206842:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787787066.206857:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787787066.206871:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787787066.206884:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787787066.206897:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787787066.206911:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787787066.206924:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787787066.206938:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787787066.206950:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787787066.206963:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787787066.206987:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787787066.207025:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060e814d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503571200:0@lo:502: 00000100:00100000:0.0:1787787066.207089:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.207345:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 00000000258ff75e going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.207370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571200 00000100:00100000:0.0:1787787066.207376:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571200 00000100:00100000:0.0:1787787066.207416:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787787066.207424:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000005c2fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503571200:12345-0@lo:502: 00000100:00100000:0.0:1787787066.207535:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000005c2fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503571200:12345-0@lo:502: Request processed in 111us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.207542:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787787066.207723:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060e814d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503571200:0@lo:502: 00000040:00080000:3.0:1787787066.207775:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787787066.207785:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:1.0:1787787066.208484:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b588e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503570432:0@lo:41: 00000020:01000004:0.0:1787787066.208800:0:7475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787787066.208821:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000597c014b) 00000020:00000080:0.0:1787787066.208840:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787787066.208932:0:7475:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000041f3c774 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787787066.208936:0:7475:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000041f3c774 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787787066.208938:0:7475:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000041f3c774 3 00010000:00080000:0.0:1787787066.208965:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000028bd7f27@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787066.211552:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1787787066.211931:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787787066.211981:0:7475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787066.211995:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x11620bc3f30a89b4 00000100:00080000:0.0:1787787066.212007:0:7475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787066.212012:0:7475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000028bd7f27 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787066.212046:0:7475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000066ec0b4e x1874630503571328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787066.212072:0:7475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787787066.212393:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ec0b4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503571328:0@lo:38: 00000100:00100000:2.0:1787787066.212472:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787787066.212962:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787787066.213115:0:7457:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787787066.213184:0:7457:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787787066.213202:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.213212:0:7457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 00000000541a6a9a/0x11620bc3f30a899f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787787066.213258:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787787066.213260:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787066.213261:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787066.213262:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787066.213264:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787066.213266:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787066.213267:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787066.213272:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787066.213274:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787066.213275:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787066.213276:0:7457:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787066.213279:0:7457:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1787787066.213281:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787066.213283:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787066.213284:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787066.213285:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787066.213286:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787066.213287:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787066.213288:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787066.213288:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787066.213289:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787066.213290:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787066.213291:0:7457:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787066.213307:0:7457:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787787066.213317:0:7457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503571456:0@lo:253: 00000100:00100000:3.0:1787787066.213358:0:7457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.213381:0:7457:0:(client.c:2715:ptlrpc_set_wait()) set 000000004867767d going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.213399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571456 00000100:00100000:3.0:1787787066.213405:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571456 00000100:00100000:3.0:1787787066.213440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787787066.213447:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009055c83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503571456:12345-0@lo:253: 20000000:01000000:3.0:1787787066.213475:0:6522:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787787066.213488:0:6522:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:0.0:1787787066.213875:0:7476:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1787787066.214278:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571328 00000100:00100000:2.0:1787787066.214284:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571328 00000100:00100000:2.0:1787787066.214327:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787066.214332:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b588e89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503571328:12345-0@lo:38: 00010000:00080000:2.0:1787787066.214355:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1787787066.214401:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x11620bc3f30a89bb 00000004:00100000:2.0:1787787066.214416:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787066.214446:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000ab63d181 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787066.214514:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b588e89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874630503571328:12345-0@lo:38: Request processed in 181us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.214520:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787787066.214825:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000066ec0b4e x1874630503571328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787066.214838:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787066.214845:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787787066.214852:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787787066.214857:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787066.214859:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000028bd7f27 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787066.214866:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ec0b4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503571328:0@lo:38: 00000001:00100000:2.0:1787787066.216536:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787787066.224945:0:6522:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787066.224963:0:6522:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787787066.225392:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787787066.225397:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787787066.225416:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.225434:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88db expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.225441:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a897c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.225447:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.225479:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a897c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.225491:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a897c expref: 15 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.225503:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066ec0b4e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503571584:0@lo:104: 00000100:00100000:0.0:1787787066.225789:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787066.225841:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a88db expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.225851:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a88db expref: 15 pid: 6520 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787066.225858:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503571712:0@lo:104: 00000100:00100000:0.0:1787787066.225879:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.225896:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a7e8a4c going to sleep for 11 seconds 00000100:00100000:0.0:1787787066.225919:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571584 00000100:00100000:0.0:1787787066.225926:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571584 00000100:00100000:0.0:1787787066.225959:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571712 00000100:00100000:0.0:1787787066.225962:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571712 00000100:00100000:0.0:1787787066.225976:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787066.225984:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060e814d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:6543:x1874630503571584:12345-0@lo:104: 00010000:00010000:0.0:1787787066.225996:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226042:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787066.226047:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060e814d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:6543:x1874630503571584:12345-0@lo:104: Request processed in 65us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.226053:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787066.226069:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787066.226087:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054915a34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503571712:12345-0@lo:104: 00010000:00010000:0.0:1787787066.226094:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226152:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787066.226303:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054915a34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503571712:12345-0@lo:104: Request processed in 229us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787066.226309:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787787066.226325:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787066.226330:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226336:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6ff0916 already unused, calling callback (0000000059df79fd) 10000000:00010000:0.0:1787787066.226339:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226346:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787066.226351:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.226355:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787066.226392:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226398:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787066.226414:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226420:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a897c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8983 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226431:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787066.226433:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226449:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d8d91c37 already unused, calling callback (0000000059df79fd) 10000000:00010000:0.0:1787787066.226450:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226456:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787066.226461:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787066.226466:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787066.226478:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226483:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787066.226496:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226500:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000d8d91c37/0x11620bc3f30a88db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787066.226514:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787066.226515:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787066.226517:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787066.226523:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787066.226533:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e258ffd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503571840:0@lo:103: 00000100:00100000:0.0:1787787066.226725:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.226840:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028b032eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503571968:0@lo:103: 00000100:00100000:0.0:1787787066.226880:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787066.227022:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009055c83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:7457:x1874630503571456:12345-0@lo:253: Request processed in 13576us (13664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.227032:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787787066.227189:0:7457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:7457:1874630503571456:0@lo:253: 10000000:01000000:3.0:1787787066.227202:0:7457:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787787066.227205:0:7457:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787066.227207:0:7457:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787066.227208:0:7457:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787066.227210:0:7457:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787066.227211:0:7457:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787066.227219:0:7457:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787066.227220:0:7457:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787066.227221:0:7457:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787066.227222:0:7457:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787066.227224:0:7457:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787066.227225:0:7457:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787066.227239:0:7457:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787787066.231809:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1787787066.231964:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787787066.232339:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787787066.232483:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787787066.232780:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787787066.232965:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1787787066.234285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571840 00000100:00100000:1.0:1787787066.234298:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571840 00010000:00010000:1.0:1787787066.234340:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a897c expref: 15 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787066.234393:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503571968 00000100:00100000:1.0:1787787066.234397:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503571968 00010000:00010000:1.0:1787787066.234410:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a88db expref: 16 pid: 6520 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787066.234428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787066.234449:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004226a608 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+16:3654:x1874630503571840:12345-0@lo:103: 00010000:00010000:1.0:1787787066.234466:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787066.234471:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a897c expref: 16 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.234484:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a897c expref: 16 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.234508:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787066.235273:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004226a608 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+16:3654:x1874630503571840:12345-0@lo:103: Request processed in 822us (8545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787066.235283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787066.235305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787066.235312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000188040d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+15:3655:x1874630503571968:12345-0@lo:103: 00010000:00010000:1.0:1787787066.235334:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787066.235339:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a88db expref: 15 pid: 6520 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235350:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a88db expref: 15 pid: 6520 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235366:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235375:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787066.235390:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009993751s 00010000:00010000:1.0:1787787066.235394:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235410:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235415:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235421:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235426:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000004bc24a2 already unused, calling callback (00000000edbd5163) 00010000:00010000:1.0:1787787066.235430:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235437:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235445:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787066.235455:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787066.235485:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000188040d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+15:3655:x1874630503571968:12345-0@lo:103: Request processed in 175us (8605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787066.235491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787787066.236309:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005b7f9a4c/0x11620bc3f30a8983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a897c expref: 14 pid: 6519 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.236325:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066ec0b4e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503571584:0@lo:104: 00010000:00010000:3.0:1787787066.236337:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039650035/0x11620bc3f30a88e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a88db expref: 13 pid: 6520 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787066.236345:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f54734f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503571712:0@lo:104: 00010000:00010000:3.0:1787787066.236365:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.236375:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.236381:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787066.236386:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004bc24a2/0x11620bc3f30a89c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787066.237304:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028b032eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503571968:0@lo:103: 00080000:10000000:3.0:1787787066.238043:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787787066.238487:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787787066.238761:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1787787066.238927:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787787066.239304:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1787787066.239499:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:0.0:1787787066.240429:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e258ffd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503571840:0@lo:103: 00000040:01000000:3.0:1787787066.242426:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787787066.242494:0:7480:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787787066.242498:0:7480:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787787066.242778:0:7481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1787787066.242829:0:7481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e258ffd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7481:1874630503572096:0@lo:700: 00000100:00100000:0.0:1787787066.242895:0:7481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787066.242934:0:7481:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035f76be4 going to sleep for 11 seconds 00000040:01000000:3.0:1787787066.242978:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787787066.243338:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572096 00000100:00100000:1.0:1787787066.243345:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572096 00000100:00100000:1.0:1787787066.243393:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787066.243402:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5d7c86 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7481:x1874630503572096:12345-0@lo:700: 00000100:00100000:3.0:1787787066.243785:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572224:0@lo:1000: 00000100:00100000:3.0:1787787066.243838:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.243865:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccfd49ec going to sleep for 11 seconds 00000040:01000000:0.0:1787787066.244419:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787787066.244542:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787066.245357:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572224 00000100:00100000:1.0:1787787066.245374:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572224 00000100:00100000:1.0:1787787066.245431:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787066.245439:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003501d033 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572224:12345-0@lo:1000: 00000100:00100000:1.0:1787787066.245543:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003501d033 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572224:12345-0@lo:1000: Request processed in 105us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787066.245550:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787066.245684:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572224:0@lo:1000: 00000040:01000000:3.0:1787787066.245722:0:7482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787787066.245760:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572352:0@lo:700: 00000100:00100000:3.0:1787787066.245793:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.245827:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572352 00000100:00100000:3.0:1787787066.245830:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572352 00000100:00100000:3.0:1787787066.245858:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787066.245864:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7c3120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:7482:x1874630503572352:12345-0@lo:700: 00000100:00100000:3.0:1787787066.245898:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7c3120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:7482:x1874630503572352:12345-0@lo:700: Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.245904:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787066.245920:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c5d2c62 going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.245930:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572352:0@lo:700: 00000100:00100000:3.0:1787787066.245970:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7482:1874630503572480:0@lo:900: 00000100:00100000:3.0:1787787066.246005:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.246032:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572480 00000100:00100000:3.0:1787787066.246035:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572480 00000100:00100000:3.0:1787787066.246059:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787066.246065:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cd64d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7482:x1874630503572480:12345-0@lo:900: 00000100:00100000:3.0:1787787066.246108:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cd64d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7482:x1874630503572480:12345-0@lo:900: Request processed in 44us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.246114:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787066.246236:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c5d2c62 going to sleep for 11 seconds 00010000:00080000:3.0:1787787066.246251:0:7482:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002e0069e3 x1874630503572480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787082 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787066.246261:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7482:1874630503572480:0@lo:900: 00000100:00100000:3.0:1787787066.246311:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572608:0@lo:1000: 00000100:00100000:3.0:1787787066.246348:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.246368:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572608 00000100:00100000:3.0:1787787066.246371:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572608 00000100:00100000:3.0:1787787066.246643:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787066.246650:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6667aac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572608:12345-0@lo:1000: 00000100:00100000:3.0:1787787066.246697:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6667aac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572608:12345-0@lo:1000: Request processed in 47us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787066.246702:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787066.246716:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed2a77eb going to sleep for 11 seconds 00000100:00100000:3.0:1787787066.246727:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572608:0@lo:1000: 00000004:00080000:3.0:1787787066.246759:0:7482:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000c5d2c62 with version 0 00000020:00100000:3.0:1787787066.246771:0:7482:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787787066.246776:0:7482:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002e0069e3 x1874630503572864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787066.246793:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572864:0@lo:1000: 00000100:00100000:3.0:1787787066.246816:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.246832:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572864 00000100:00100000:3.0:1787787066.246835:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572864 00000100:00100000:3.0:1787787066.246852:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787066.246857:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004ae4f0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572864:12345-0@lo:1000: 00000004:00000080:0.0:1787787066.247255:0:7457:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787787066.247266:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787787066.247441:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787066.248375:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000893b7757 going to sleep for 11 seconds 00000001:00080000:2.0:1787787066.250329:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000040:00080000:0.0:1787787066.250777:0:7457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787787066.251828:0:7457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787787066.251883:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787787066.252389:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787787066.252626:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787787066.253416:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787787066.253541:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787787066.253738:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787787066.253880:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787787066.254026:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787787066.254427:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787787066.254545:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787787066.254772:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787787066.254919:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787787066.255186:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787787066.255341:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787787066.255475:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787787066.255665:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787787066.255802:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787787066.255939:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787787066.256106:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787787066.256482:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787787066.256619:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787787066.256767:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787787066.256908:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787787066.257042:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787787066.257225:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787787066.257357:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787787066.257507:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787787066.257644:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787787066.257783:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787787066.257931:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 40000000:02000000:1.0:1787787066.258731:0:6534:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1787787066.260423:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004ae4f0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572864:12345-0@lo:1000: Request processed in 13558us (13599us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787787066.260438:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:0.0:1787787066.261898:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787787066.262108:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787787066.263522:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787787066.263786:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787787066.263941:0:7457:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787787066.265083:0:7457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787787066.267044:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5d7c86 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7481:x1874630503572096:12345-0@lo:700: Request processed in 23634us (24139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787066.267059:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787787066.267576:0:7481:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004e258ffd x1874630503572096/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787787082 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787066.267615:0:7481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e258ffd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7481:1874630503572096:0@lo:700: 40000000:02000000:0.0:1787787066.267629:0:7481:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:1.0:1787787066.270670:0:7482:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787787066.270681:0:7482:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787787066.270705:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e0069e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572864:0@lo:1000: 00000100:00100000:1.0:1787787066.270961:0:7482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd9995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572992:0@lo:1000: 00000100:00100000:1.0:1787787066.271043:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787066.273885:0:7482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029c1b08c going to sleep for 11 seconds 00000100:00100000:2.0:1787787066.279792:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503572992 00000100:00100000:2.0:1787787066.279807:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503572992 00000100:00100000:2.0:1787787066.279870:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787066.279881:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c3d330 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572992:12345-0@lo:1000: 00000100:00100000:2.0:1787787066.280057:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c3d330 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7482:x1874630503572992:12345-0@lo:1000: Request processed in 178us (9014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787066.280064:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00080000:0.0:1787787066.280493:0:7457:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787787066.280524:0:7457:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa62241c6f988 00100000:10000000:0.0:1787787066.280532:0:7457:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:1.0:1787787066.281841:0:7482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd9995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7482:1874630503572992:0@lo:1000: 00000040:00080000:1.0:1787787066.281904:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787787066.281952:0:7482:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001dc9048a with version 1 00000020:01000004:0.0:1787787066.283747:0:7457:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787066.283783:0:7457:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787066.283802:0:7457:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787787066.283842:0:7457:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:3.0:1787787066.288742:0:7472:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000002fb63e32 version 1 rpc_version 1 00000020:00100000:3.0:1787787066.288838:0:7472:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787787066.288851:0:7472:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004f4a2587 x1874630503573248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787066.288878:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f4a2587 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7472:1874630503573248:0@lo:1000: 00000100:00100000:3.0:1787787066.288953:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787066.289019:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2c88f77 going to sleep for 11 seconds 00000100:00100000:2.0:1787787066.289104:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503573248 00000100:00100000:2.0:1787787066.289113:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503573248 00000100:00100000:2.0:1787787066.289208:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787066.289217:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073ba04dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874630503573248:12345-0@lo:1000: 00000040:00080000:1.0:1787787066.290099:0:7482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787787066.290489:0:7482:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:00000004:1.0:1787787066.292728:0:7457:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787066.292931:0:7457:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1787787066.321343:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1787787066.321658:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073ba04dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1874630503573248:12345-0@lo:1000: Request processed in 32437us (32700us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787787066.321672:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787787066.321738:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787787066.321743:0:7472:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787787066.321762:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f4a2587 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7472:1874630503573248:0@lo:1000: 00000040:00080000:2.0:1787787066.334662:0:7481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787066.343344:0:7481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787787066.343413:0:7481:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787787066.343417:0:7481:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1787787067.183324:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787068.211166:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787069.228217:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787070.250098:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787070.842309:0:7727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787787071.275885:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787071.340316:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072b50bf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503573632:0@lo:400: 00000100:00100000:0.0:1787787071.340385:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787071.340449:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028b032eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503573760:0@lo:400: 00000100:00100000:0.0:1787787071.340449:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787071.340454:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e258ffd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503573504:0@lo:400: 00000100:00100000:0.0:1787787071.340480:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787071.340497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787071.340514:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503573504 00000100:00100000:1.0:1787787071.340516:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787787071.340521:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503573504 00000100:00100000:1.0:1787787071.340527:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503573376:0@lo:400: 00000100:00100000:1.0:1787787071.340554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787071.340556:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503573760 00000100:00100000:0.0:1787787071.340559:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503573760 00000100:00100000:1.0:1787787071.340574:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cd9995 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503573888:0@lo:41: 00000100:00100000:0.0:1787787071.340574:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787071.340581:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066ec0b4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503573504:12345-0@lo:400: 00000100:00100000:1.0:1787787071.340593:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787071.340613:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787071.340621:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787787071.340628:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066ec0b4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503573504:12345-0@lo:400: Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787071.340635:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787071.340652:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787071.340664:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd78326c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503573760:12345-0@lo:400: 00000100:00100000:0.0:1787787071.340697:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd78326c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503573760:12345-0@lo:400: Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787071.340702:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787071.340721:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503573376 00000100:00100000:0.0:1787787071.340724:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503573376 00000100:00100000:0.0:1787787071.340745:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787071.340752:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cb9c598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:3655:x1874630503573376:12345-0@lo:400: 00000100:00100000:0.0:1787787071.340782:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cb9c598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:3655:x1874630503573376:12345-0@lo:400: Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787071.340788:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787071.340823:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503573376:0@lo:400: 00010000:00080000:0.0:1787787071.340835:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000028b032eb x1874630503573760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787071.340845:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028b032eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503573760:0@lo:400: 00010000:00080000:0.0:1787787071.340876:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004e258ffd x1874630503573504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787071.340884:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e258ffd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503573504:0@lo:400: 00000100:00100000:3.0:1787787071.342066:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503573632 00000100:00100000:3.0:1787787071.342074:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503573632 00000100:00100000:3.0:1787787071.342106:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503573888 00000100:00100000:3.0:1787787071.342108:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503573888 00000100:00100000:3.0:1787787071.342120:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787071.342127:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f54734f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874630503573632:12345-0@lo:400: 00000100:00100000:3.0:1787787071.342285:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f54734f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874630503573632:12345-0@lo:400: Request processed in 158us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787071.342292:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787071.342306:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787071.342312:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adf8e639 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503573888:12345-0@lo:41: 00000004:00000024:3.0:1787787071.342335:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787787071.342372:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adf8e639 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503573888:12345-0@lo:41: Request processed in 62us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787071.342378:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787071.342434:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cd9995 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503573888:0@lo:41: 00000100:00100000:0.0:1787787071.342558:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072b50bf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503573632:0@lo:400: 00000020:00000004:1.0:1787787071.766731:0:7780:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787071.766912:0:7780:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787072.303608:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787073.322430:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787074.346396:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787787074.683769:0:7881:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787074.683985:0:7881:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787787075.369254:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787787075.750517:0:7929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff315faaa0 20000000:00000080:2.0:1787787075.750536:0:7929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9870fc19f800 uarg=0000000000000000 20000000:01000000:2.0:1787787075.750576:0:7929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787787075.750583:0:7929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787787075.750588:0:7929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787787075.751046:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787787075.751060:0:7929:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787787075.756589:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787075.756832:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787787075.756862:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787787075.756876:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787787075.756902:0:7929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787787075.756918:0:7929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.756937:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.756944:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.756950:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.757055:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.757203:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 12 pid: 6520 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787075.757218:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1874630503574016:0@lo:104: 00000100:00100000:2.0:1787787075.757422:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787075.757594:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.757602:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 12 pid: 6522 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787075.757610:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067734e90 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1874630503574144:0@lo:104: 00000100:00100000:2.0:1787787075.757632:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ba5add2 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.757725:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787787075.757745:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.759791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574016 00000100:00100000:0.0:1787787075.759804:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574016 00000100:00100000:1.0:1787787075.759877:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574144 00000100:00100000:1.0:1787787075.759882:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574144 00000100:00100000:1.0:1787787075.759921:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787075.759929:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acbe1407 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:7929:x1874630503574016:12345-0@lo:104: 00010000:00010000:1.0:1787787075.759945:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760046:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787075.760051:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acbe1407 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:7929:x1874630503574016:12345-0@lo:104: Request processed in 123us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.760067:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787075.760112:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787075.760118:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028b032eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:7929:x1874630503574144:12345-0@lo:104: 00010000:00010000:1.0:1787787075.760125:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760177:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787075.760181:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028b032eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:7929:x1874630503574144:12345-0@lo:104: Request processed in 65us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.760187:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787787075.760223:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787075.760227:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760236:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c102226b already unused, calling callback (0000000059df79fd) 10000000:00010000:1.0:1787787075.760239:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760261:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787075.760266:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787075.760271:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787075.760304:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760310:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787075.760341:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760348:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000c102226b/0x11620bc3f30a8991 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8998 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760362:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787075.760364:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760369:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0e225cf already unused, calling callback (0000000059df79fd) 10000000:00010000:1.0:1787787075.760370:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760382:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787075.760386:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787075.760391:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787075.760404:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760409:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787075.760413:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760418:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: 00000000f0e225cf/0x11620bc3f30a88a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a88aa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760430:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787075.760432:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787075.760433:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787075.760439:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787787075.760459:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787075.760462:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870d2373000 from 4 10000000:01000000:1.0:1787787075.760465:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787075.760484:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760490:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760507:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787075.760522:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6711388 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574528:0@lo:101: 00000100:00100000:1.0:1787787075.760560:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.760590:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011835d2d going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.760609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574528 00000100:00100000:1.0:1787787075.760613:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574528 00000100:00100000:1.0:1787787075.760641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787075.760648:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d46832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503574528:12345-0@lo:101: 00010000:00010000:1.0:1787787075.760659:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787075.760670:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa996a27/0x11620bc3f30a89d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a89d0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760688:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa996a27/0x11620bc3f30a89d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760697:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa996a27/0x11620bc3f30a89d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760704:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa996a27, rc 0) 00000100:00100000:1.0:1787787075.760732:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d46832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503574528:12345-0@lo:101: Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.760738:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787075.760773:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6711388 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574528:0@lo:101: 00010000:00010000:1.0:1787787075.760784:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.760803:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787075.760848:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6711388 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574656:0@lo:256: 00000100:00100000:1.0:1787787075.760877:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.760905:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011835d2d going to sleep for 11 seconds 00000100:00100000:2.0:1787787075.761564:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d842920 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1874630503574016:0@lo:104: 00000100:00100000:2.0:1787787075.761574:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067734e90 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1874630503574144:0@lo:104: 00010000:00010000:2.0:1787787075.761594:0:7929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787075.762196:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574656 00000100:00100000:1.0:1787787075.762203:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574656 00000100:00100000:3.0:1787787075.762227:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041166d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503574272:0@lo:103: 00000100:00100000:1.0:1787787075.762252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787075.762259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f19a53db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503574656:12345-0@lo:256: 00000100:00100000:3.0:1787787075.762272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1787787075.762278:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787075.762298:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787075.762301:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787787075.762311:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787075.762316:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ce54652 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503574400:0@lo:103: 00000100:00100000:3.0:1787787075.763029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.763081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574272 00000100:00100000:3.0:1787787075.763086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574272 00010000:00010000:3.0:1787787075.763111:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 16 pid: 6520 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787075.763135:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574400 00000100:00100000:3.0:1787787075.763155:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574400 00010000:00010000:3.0:1787787075.763176:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 17 pid: 6522 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787075.763191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787075.763197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c72682bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+17:3653:x1874630503574272:12345-0@lo:103: 00010000:00010000:3.0:1787787075.763208:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787075.763212:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 17 pid: 6520 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.763222:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 17 pid: 6520 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.763238:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa7a6457/0x11620bc3f30a8998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8991 expref: 17 pid: 6520 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.763251:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787075.763286:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c72682bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+16:3653:x1874630503574272:12345-0@lo:103: Request processed in 90us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.763293:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787075.763307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787075.763312:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0799df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+15:3653:x1874630503574400:12345-0@lo:103: 00010000:00010000:3.0:1787787075.763320:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787075.763323:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 15 pid: 6522 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.763331:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 15 pid: 6522 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764018:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d0be694/0x11620bc3f30a88aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a88a3 expref: 15 pid: 6522 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764042:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764049:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764063:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764068:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764074:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764079:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764084:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038b9b0a0 already unused, calling callback (00000000edbd5163) 00010000:00010000:3.0:1787787075.764086:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764093:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764112:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.764121:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787075.764427:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0799df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+14:3653:x1874630503574400:12345-0@lo:103: Request processed in 1114us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.764444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787075.764548:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ce54652 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503574400:0@lo:103: 00000100:00100000:3.0:1787787075.764557:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041166d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503574272:0@lo:103: 00010000:00010000:2.0:1787787075.764639:0:7929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.764648:0:7929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.764654:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038b9b0a0/0x11620bc3f30a89c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787075.765303:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f19a53db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+12:6524:x1874630503574656:12345-0@lo:256: Request processed in 3042us (4424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.765313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787075.765637:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6711388 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574656:0@lo:256: 10000000:01000000:0.0:1787787075.765689:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787075.765696:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.765704:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: 000000009af0d7ae/0x11620bc3f30a89d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787075.765714:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787075.765716:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870d2373000 from 1 10000000:01000000:0.0:1787787075.765719:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787075.765749:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a89de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.765755:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a89de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.765763:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a89de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787075.765777:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574784:0@lo:101: 00000100:00100000:0.0:1787787075.765809:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.765846:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8e17c73 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.766394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574784 00000100:00100000:1.0:1787787075.766401:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574784 00000100:00100000:1.0:1787787075.766434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787075.766440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bf1c840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+12:6524:x1874630503574784:12345-0@lo:101: 00010000:00010000:1.0:1787787075.766462:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787075.766473:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b78adcc/0x11620bc3f30a89e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a89de expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.766493:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b78adcc/0x11620bc3f30a89e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a89de expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.766514:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b78adcc/0x11620bc3f30a89e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89de expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.766522:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b78adcc, rc 0) 00000100:00100000:1.0:1787787075.766562:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bf1c840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503574784:12345-0@lo:101: Request processed in 122us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.766568:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787075.766679:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000040b4b43 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574784:0@lo:101: 00010000:00010000:2.0:1787787075.766697:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a89de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.766705:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: 00000000c6ff0916/0x11620bc3f30a89de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787075.766763:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067734e90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574912:0@lo:501: 00000100:00100000:2.0:1787787075.766791:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.766817:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ba5add2 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.766903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503574912 00000100:00100000:0.0:1787787075.766907:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503574912 00000100:00100000:0.0:1787787075.766935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787075.766940:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018522f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503574912:12345-0@lo:501: 00000100:00100000:0.0:1787787075.767226:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018522f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503574912:12345-0@lo:501: Request processed in 285us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.767233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787075.767414:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067734e90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503574912:0@lo:501: 00000100:00100000:0.0:1787787075.767443:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000017ee127 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575040:0@lo:503: 00000100:00100000:0.0:1787787075.767544:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.767595:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8e17c73 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.768706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575040 00000100:00100000:1.0:1787787075.768717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575040 00000100:00100000:1.0:1787787075.768768:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787075.768776:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b6351e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503575040:12345-0@lo:503: 00000100:00100000:1.0:1787787075.769057:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b6351e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503575040:12345-0@lo:503: Request processed in 282us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.769065:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787075.769175:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000017ee127 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575040:0@lo:503: 00000100:00100000:0.0:1787787075.776666:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015c7aaef pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7930:1874630503575168:0@lo:502: 00000100:00100000:0.0:1787787075.776748:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.776798:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084f640ae going to sleep for 11 seconds 00000100:00100000:3.0:1787787075.776856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575168 00000100:00100000:3.0:1787787075.776864:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575168 00000100:00100000:3.0:1787787075.776918:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787075.776926:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb7290a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+13:7930:x1874630503575168:12345-0@lo:502: 00000100:00100000:3.0:1787787075.777051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb7290a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+13:7930:x1874630503575168:12345-0@lo:502: Request processed in 126us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.777059:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787787075.777172:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015c7aaef pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7930:1874630503575168:0@lo:502: 00000020:01000000:0.0:1787787075.777202:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787075.777211:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787075.777213:0:7930:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787787075.777220:0:7930:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870d2373000 00000020:00000080:0.0:1787787075.777223:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787787075.777260:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7930:1874630503575296:0@lo:502: 00000100:00100000:0.0:1787787075.777292:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.777321:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e08329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787075.777663:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575296 00000100:00100000:2.0:1787787075.777668:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575296 00000100:00100000:2.0:1787787075.777696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787075.777702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:7930:x1874630503575296:12345-0@lo:502: 00000100:00100000:2.0:1787787075.777781:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:7930:x1874630503575296:12345-0@lo:502: Request processed in 79us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787075.777788:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787787075.777840:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7930:1874630503575296:0@lo:502: 00000020:01000000:0.0:1787787075.777861:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787075.777866:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787075.777867:0:7930:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787787075.777870:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787787075.778020:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787787075.778043:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787075.778052:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.778064:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787075.778073:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787787075.778076:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c3240800 from 21 10000000:01000000:3.0:1787787075.778079:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787075.778103:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.778112:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.778132:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787075.778175:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575424:0@lo:101: 00000100:00100000:3.0:1787787075.778202:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.778228:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787075.778250:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575424 00000100:00100000:2.0:1787787075.778255:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575424 00000100:00100000:2.0:1787787075.778284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787787075.778291:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+13:6524:x1874630503575424:12345-0@lo:101: 00010000:00010000:2.0:1787787075.778300:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787075.778312:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a89ec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.778332:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.778352:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.778367:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391200, rc 0) 00000100:00100000:2.0:1787787075.778401:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503575424:12345-0@lo:101: Request processed in 111us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787075.778408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787075.778738:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575424:0@lo:101: 00010000:00010000:3.0:1787787075.778749:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.778758:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787075.778805:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575552:0@lo:501: 00000100:00100000:3.0:1787787075.778829:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.778852:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787075.778924:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575552 00000100:00100000:2.0:1787787075.778929:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575552 00000100:00100000:2.0:1787787075.778977:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787075.778985:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503575552:12345-0@lo:501: 00000100:00100000:2.0:1787787075.780686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503575552:12345-0@lo:501: Request processed in 1695us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787075.780698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787075.781120:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575552:0@lo:501: 00000100:00100000:3.0:1787787075.781185:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575680:0@lo:503: 00000100:00100000:3.0:1787787075.781237:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.781266:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.781327:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575680 00000100:00100000:0.0:1787787075.781333:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575680 00000100:00100000:0.0:1787787075.781376:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787075.781385:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503575680:12345-0@lo:503: 00000100:00100000:0.0:1787787075.781489:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503575680:12345-0@lo:503: Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.781505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787075.781617:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503575680:0@lo:503: 00000100:00100000:1.0:1787787075.782724:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d96452c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7931:1874630503575808:0@lo:502: 00000100:00100000:1.0:1787787075.782782:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.782818:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d23799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.782867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575808 00000100:00100000:0.0:1787787075.782873:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575808 00000100:00100000:0.0:1787787075.785647:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787787075.785666:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:7931:x1874630503575808:12345-0@lo:502: 00000100:00100000:0.0:1787787075.785841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:7931:x1874630503575808:12345-0@lo:502: Request processed in 181us (3058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.785848:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787787075.785954:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d96452c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7931:1874630503575808:0@lo:502: 00000100:00100000:3.0:1787787075.786021:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7931:1874630503575936:0@lo:502: 00000100:00100000:3.0:1787787075.786066:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.792161:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503575936 00000100:00100000:1.0:1787787075.792175:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503575936 00000100:00100000:1.0:1787787075.792237:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787787075.792259:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:7931:x1874630503575936:12345-0@lo:502: 00000100:00100000:1.0:1787787075.792411:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:7931:x1874630503575936:12345-0@lo:502: Request processed in 154us (6345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.792418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787075.793009:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787075.793043:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7931:1874630503575936:0@lo:502: 00000040:00080000:3.0:1787787075.793093:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787787075.793778:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787787075.793801:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787075.793811:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.793823:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787075.793833:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787075.793836:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c3240800 from 4 10000000:01000000:0.0:1787787075.793839:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787075.793871:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.793878:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.793899:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787075.793920:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576064:0@lo:101: 00000100:00100000:0.0:1787787075.794232:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.794459:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832540 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.794475:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576064 00000100:00100000:0.0:1787787075.794481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576064 00000100:00100000:3.0:1787787075.794857:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787075.794868:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503576064:12345-0@lo:101: 00010000:00010000:3.0:1787787075.794881:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787075.794905:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a89fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.794928:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.794938:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.795203:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6800, rc 0) 00000100:00100000:3.0:1787787075.795379:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503576064:12345-0@lo:101: Request processed in 511us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.795386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787787075.798202:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576064:0@lo:101: 00010000:00010000:1.0:1787787075.798234:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.798796:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787075.798875:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576192:0@lo:256: 00000100:00100000:1.0:1787787075.802012:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.802172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576192 00000100:00100000:0.0:1787787075.802181:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576192 00000100:00100000:0.0:1787787075.802228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787787075.802238:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503576192:12345-0@lo:256: 20000000:01000000:0.0:1787787075.802378:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787787075.802394:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787787075.802398:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787787075.802660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503576192:12345-0@lo:256: Request processed in 423us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.802669:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787075.803331:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.803358:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576192:0@lo:256: 10000000:01000000:1.0:1787787075.803416:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787075.803426:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.803437:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787075.804590:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787787075.804596:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787787075.804602:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787075.804645:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.804655:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.804666:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787075.804699:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576320:0@lo:101: 00000100:00100000:1.0:1787787075.804756:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.804800:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.805091:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576320 00000100:00100000:0.0:1787787075.805099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576320 00000100:00100000:0.0:1787787075.805186:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787075.805195:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503576320:12345-0@lo:101: 00010000:00010000:0.0:1787787075.805207:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787075.805219:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8a08 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.805566:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.805579:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.805589:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14400, rc 0) 00000100:00100000:0.0:1787787075.805655:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503576320:12345-0@lo:101: Request processed in 461us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.805663:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787787075.805719:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576320:0@lo:101: 00010000:00010000:2.0:1787787075.805740:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787075.805749:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787075.805806:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576448:0@lo:501: 00000100:00100000:2.0:1787787075.805834:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.805860:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.806341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576448 00000100:00100000:0.0:1787787075.806347:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576448 00000100:00100000:0.0:1787787075.806383:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787787075.806391:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503576448:12345-0@lo:501: 00000100:00100000:0.0:1787787075.807830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503576448:12345-0@lo:501: Request processed in 1435us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.807841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787787075.808543:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576448:0@lo:501: 00000100:00100000:2.0:1787787075.808594:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576576:0@lo:503: 00000100:00100000:2.0:1787787075.808714:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.808752:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.810998:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576576 00000100:00100000:0.0:1787787075.811011:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576576 00000100:00100000:0.0:1787787075.811068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787075.811078:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503576576:12345-0@lo:503: 00000100:00100000:0.0:1787787075.811326:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503576576:12345-0@lo:503: Request processed in 248us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.811334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787787075.811443:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503576576:0@lo:503: 00000100:00100000:0.0:1787787075.812338:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7934:1874630503576704:0@lo:502: 00000100:00100000:0.0:1787787075.812394:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.812447:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.812710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576704 00000100:00100000:1.0:1787787075.812717:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576704 00000100:00100000:1.0:1787787075.812759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787075.812768:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:7934:x1874630503576704:12345-0@lo:502: 00000100:00100000:1.0:1787787075.812871:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:7934:x1874630503576704:12345-0@lo:502: Request processed in 104us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.812879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787075.812915:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7934:1874630503576704:0@lo:502: 00000020:01000000:0.0:1787787075.812949:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787075.812960:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787075.812963:0:7934:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787787075.812969:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787075.812974:0:7934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:00000080:0.0:1787787075.812997:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787075.813031:0:7934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9870f577b370) 00000020:00000080:0.0:1787787075.813052:0:7934:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1787787075.813059:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787075.813398:0:7934:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787787075.813404:0:7934:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787787075.813411:0:7934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a8a1d 00010000:00080000:0.0:1787787075.813544:0:7934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870f5601800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787075.815291:0:7934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1787787075.829325:0:7934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787075.829339:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787787075.829377:0:7934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787787075.829399:0:7934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a8a24 00000100:00080000:0.0:1787787075.829410:0:7934:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787075.829416:0:7934:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870f5601800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787075.829461:0:7934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870d4e612c0 x1874630503576832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787075.829495:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503576832:0@lo:38: 00000100:00100000:0.0:1787787075.829561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787075.829615:0:7934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1787787075.829654:0:7934:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787787075.829697:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503576960:0@lo:400: 00000100:00100000:2.0:1787787075.829732:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.829759:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787075.829766:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503577088:0@lo:400: 00000100:00100000:2.0:1787787075.829789:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.829817:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503577216:0@lo:400: 00000100:00100000:2.0:1787787075.829841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.829859:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787075.829864:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503577344:0@lo:400: 00000100:00100000:2.0:1787787075.829884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787075.829928:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576832 00000100:00100000:2.0:1787787075.829935:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576832 00000100:00100000:2.0:1787787075.829954:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577216 00000100:00100000:2.0:1787787075.829957:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577216 00000100:00100000:2.0:1787787075.829981:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787075.829988:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503576832:12345-0@lo:38: 00010000:00080000:2.0:1787787075.830011:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1787787075.830044:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a8a2b 00000004:00100000:2.0:1787787075.830058:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787787075.830064:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787787075.830159:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577088 00000100:00100000:2.0:1787787075.830162:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577088 00000100:00100000:2.0:1787787075.830189:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577344 00000100:00100000:2.0:1787787075.830191:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577344 00000100:00100000:2.0:1787787075.830207:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787075.830214:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503577088:12345-0@lo:400: 00000100:00100000:2.0:1787787075.830269:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503577088:12345-0@lo:400: Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.830274:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503576960 00000100:00100000:2.0:1787787075.830276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787075.830278:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503576960 00000100:00100000:2.0:1787787075.830291:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787075.830296:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503577344:12345-0@lo:400: 00000100:00100000:0.0:1787787075.830301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787787075.830306:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:3655:x1874630503576960:12345-0@lo:400: 00000100:00100000:2.0:1787787075.830326:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503577344:12345-0@lo:400: Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.830330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:3655:x1874630503576960:12345-0@lo:400: Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787075.830333:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787075.830336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1787787075.830365:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870d4ed2940 x1874630503577088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787075.830377:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503577088:0@lo:400: 00000100:00100000:2.0:1787787075.830386:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503576960:0@lo:400: 00010000:00080000:2.0:1787787075.830414:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870d4ed0780 x1874630503577344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787075.830422:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503577344:0@lo:400: 00000100:00080000:1.0:1787787075.831046:0:7938:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9870d9647840 x1874630503577472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787075.831298:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 0 seconds 00000020:01000000:0.0:1787787075.831592:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787075.831605:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787075.831607:0:7934:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787787075.831611:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787075.831614:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787075.831616:0:7934:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787075.831618:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787075.831621:0:7934:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787787075.831645:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7934:1874630503577600:0@lo:502: 00000100:00100000:0.0:1787787075.831702:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.831738:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1556300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.831822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577600 00000100:00100000:0.0:1787787075.831827:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577600 00000100:00100000:0.0:1787787075.831862:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787787075.831869:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:7934:x1874630503577600:12345-0@lo:502: 00000100:00100000:0.0:1787787075.832225:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:7934:x1874630503577600:12345-0@lo:502: Request processed in 355us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.832233:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787075.832372:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7934:1874630503577600:0@lo:502: 00000020:01000000:1.0:1787787075.832397:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787075.832401:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787075.832403:0:7934:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787787075.832406:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787787075.833207:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787787075.833229:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787787075.833548:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.833563:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787075.833573:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787075.833576:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3240800 from 1 10000000:01000000:3.0:1787787075.833579:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787075.833609:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.833624:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.833635:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787075.833653:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503577728:0@lo:101: 00000100:00100000:3.0:1787787075.833700:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.833737:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.834183:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577728 00000100:00100000:1.0:1787787075.834191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577728 00000100:00100000:1.0:1787787075.834235:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787075.834345:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503577728:12345-0@lo:101: 00010000:00010000:1.0:1787787075.834358:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787075.834372:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8a32 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.834409:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.834420:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787075.834428:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5200, rc 0) 00000100:00100000:1.0:1787787075.835222:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503577728:12345-0@lo:101: Request processed in 877us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.835230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787787075.835700:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503577728:0@lo:101: 00010000:00010000:3.0:1787787075.835720:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.835731:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787075.835805:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503577856:0@lo:501: 00000100:00100000:3.0:1787787075.835841:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.835867:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.835928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577856 00000100:00100000:0.0:1787787075.835934:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577856 00000100:00100000:0.0:1787787075.835991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787075.836000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503577856:12345-0@lo:501: 00000100:00100000:0.0:1787787075.836436:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503577856:12345-0@lo:501: Request processed in 436us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.836651:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503577856:0@lo:501: 00000100:00100000:3.0:1787787075.836684:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503577984:0@lo:503: 00000100:00100000:3.0:1787787075.836731:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.836751:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.837118:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787075.837166:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577984 00000100:00100000:0.0:1787787075.837171:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577984 00000100:00100000:0.0:1787787075.837197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787075.837204:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503577984:12345-0@lo:503: 00000100:00100000:0.0:1787787075.837437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503577984:12345-0@lo:503: Request processed in 232us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.837688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787075.837733:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503577984:0@lo:503: 00000100:00100000:3.0:1787787075.838935:0:7939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7939:1874630503578112:0@lo:502: 00000100:00100000:3.0:1787787075.839361:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.839401:0:7939:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.839573:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578112 00000100:00100000:0.0:1787787075.839580:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578112 00000100:00100000:0.0:1787787075.839621:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787075.839630:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:7939:x1874630503578112:12345-0@lo:502: 00000100:00100000:0.0:1787787075.839739:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:7939:x1874630503578112:12345-0@lo:502: Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.839747:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787787075.840206:0:7939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7939:1874630503578112:0@lo:502: 00000020:01000000:3.0:1787787075.840237:0:7939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787075.840808:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787075.840810:0:7939:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787075.840818:0:7939:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870c3240800 00000020:00000080:3.0:1787787075.840821:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787787075.840851:0:7939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7939:1874630503578240:0@lo:502: 00000100:00100000:3.0:1787787075.840916:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787075.840948:0:7939:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.841192:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578240 00000100:00100000:1.0:1787787075.841198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578240 00000100:00100000:1.0:1787787075.841245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787787075.841254:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:7939:x1874630503578240:12345-0@lo:502: 00000100:00100000:1.0:1787787075.841349:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:7939:x1874630503578240:12345-0@lo:502: Request processed in 95us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.841356:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787787075.841715:0:7939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:7939:1874630503578240:0@lo:502: 00000020:01000000:3.0:1787787075.841741:0:7939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787075.841746:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787075.841748:0:7939:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787787075.841752:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787787075.842014:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787787075.842048:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787075.842195:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.842207:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787075.842217:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787787075.842219:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9870d15599b8 from 1 10000000:01000000:0.0:1787787075.842222:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787075.842571:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.842580:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.842591:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787075.842618:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503578368:0@lo:101: 00000100:00100000:0.0:1787787075.842670:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.842699:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1556c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.842715:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578368 00000100:00100000:0.0:1787787075.842720:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578368 00000100:00100000:0.0:1787787075.842755:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787787075.842763:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503578368:12345-0@lo:101: 00010000:00010000:0.0:1787787075.842773:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787075.842784:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8a40 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.842805:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.842815:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.842824:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15800, rc 0) 00000100:00100000:0.0:1787787075.842908:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503578368:12345-0@lo:101: Request processed in 145us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.842915:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787787075.843407:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503578368:0@lo:101: 00010000:00010000:3.0:1787787075.843420:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787075.843429:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787787075.844182:0:6532:0:(import.c:65:import_set_state_nolock()) ffff9870fc17d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787075.844262:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503576832:12345-0@lo:38: Request processed in 14272us (14700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.844271:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787075.844279:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787075.844288:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1787787075.844292:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787787075.844295:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00100000:3.0:1787787075.844300:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503577216:12345-0@lo:400: 00000100:00080000:1.0:1787787075.844300:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787787075.844303:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f5601800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787787075.844317:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a27eae68): req@ffff9870d9647840 x1874630503577472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787075.844332:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503576832:0@lo:38: 00000100:00100000:3.0:1787787075.844353:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503577216:12345-0@lo:400: Request processed in 54us (14511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.844360:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787075.844383:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.844416:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503577472 00000100:00100000:1.0:1787787075.844421:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503577472 00000100:00100000:2.0:1787787075.844539:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503577216:0@lo:400: 00000100:00100000:2.0:1787787075.844577:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503578496:0@lo:41: 00000100:00100000:2.0:1787787075.844606:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.844914:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503578624:0@lo:501: 00000100:00100000:0.0:1787787075.845131:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.845176:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1556b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.845204:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578624 00000100:00100000:0.0:1787787075.845208:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578624 00000100:00100000:0.0:1787787075.845235:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787075.845318:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503578624:12345-0@lo:501: 00000100:00100000:0.0:1787787075.845387:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503578624:12345-0@lo:501: Request processed in 71us (255us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787075.845394:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787075.845425:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503578624:0@lo:501: 10000000:01000000:0.0:1787787075.845572:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787787075.845581:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787075.845592:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787075.848232:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.850210:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578496 00000100:00100000:1.0:1787787075.850228:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578496 00000100:00100000:3.0:1787787075.850383:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787075.850406:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7938:x1874630503577472:12345-0@lo:1000: 00000100:00100000:3.0:1787787075.850792:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7938:x1874630503577472:12345-0@lo:1000: Request processed in 398us (6406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.850800:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787075.850883:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503577472:0@lo:1000: 00000040:01000000:1.0:1787787075.850934:0:7938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787787075.852226:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787075.852236:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503578496:12345-0@lo:41: 00000004:00000024:0.0:1787787075.852266:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787787075.852320:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503578496:12345-0@lo:41: Request processed in 86us (7713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.852326:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787075.852486:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503578496:0@lo:41: 00000100:00100000:1.0:1787787075.852771:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503578752:0@lo:1000: 00000100:00100000:1.0:1787787075.852816:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.852873:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787075.852911:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578752 00000100:00100000:3.0:1787787075.852918:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578752 00000100:00100000:3.0:1787787075.853681:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787075.853693:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503578752:12345-0@lo:1000: 00000100:00100000:3.0:1787787075.853915:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503578752:12345-0@lo:1000: Request processed in 224us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787075.853922:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787075.854209:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503578752:0@lo:1000: 00000100:00100000:1.0:1787787075.854272:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503578880:0@lo:700: 00000100:00100000:1.0:1787787075.854308:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.854343:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503578880 00000100:00100000:1.0:1787787075.854348:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503578880 00000100:00100000:1.0:1787787075.854380:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787075.854386:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9645e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503578880:12345-0@lo:700: 00000100:00100000:1.0:1787787075.854421:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9645e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503578880:12345-0@lo:700: Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787075.854427:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787075.854655:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.854672:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503578880:0@lo:700: 00000100:00100000:1.0:1787787075.854815:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503579008:0@lo:1000: 00000100:00100000:1.0:1787787075.854841:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.855256:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.855302:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503579008 00000100:00100000:0.0:1787787075.855307:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503579008 00000100:00100000:0.0:1787787075.855336:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787075.855343:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503579008:12345-0@lo:1000: 00000100:00100000:0.0:1787787075.855409:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503579008:12345-0@lo:1000: Request processed in 66us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.855416:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787075.859607:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503579008:0@lo:1000: 00000004:00080000:1.0:1787787075.859691:0:7938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9870d154e000 with version 0 00000020:00100000:1.0:1787787075.859716:0:7938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787787075.859729:0:7938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9870d9647840 x1874630503579264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787075.859750:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503579264:0@lo:1000: 00000100:00100000:1.0:1787787075.859805:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787075.859852:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503579264 00000100:00100000:1.0:1787787075.859858:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503579264 00000100:00100000:1.0:1787787075.859908:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787075.859917:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7938:x1874630503579264:12345-0@lo:1000: 00000100:00100000:0.0:1787787075.862234:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e840 going to sleep for 11 seconds 00000001:00080000:2.0:1787787075.866374:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787787075.866386:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787787075.867386:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7938:x1874630503579264:12345-0@lo:1000: Request processed in 7463us (7573us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787787075.867401:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787787075.867532:0:7938:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787787075.867538:0:7938:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787787075.867565:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503579264:0@lo:1000: 00000100:00100000:3.0:1787787075.867663:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503579392:0@lo:1000: 00000100:00100000:3.0:1787787075.867701:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.867737:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503579392 00000100:00100000:3.0:1787787075.867739:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc108300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787075.867745:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503579392 00000100:00100000:0.0:1787787075.867785:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787075.867794:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7938:x1874630503579392:12345-0@lo:1000: 00000100:00100000:0.0:1787787075.867868:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7938:x1874630503579392:12345-0@lo:1000: Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787075.867874:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787075.867939:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7938:1874630503579392:0@lo:1000: 00000040:00080000:3.0:1787787075.867958:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787787075.867996:0:7938:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9870fc108d80 with version 1 00000004:00080000:0.0:1787787075.868159:0:7935:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9870e0832d80 version 1 rpc_version 1 00000020:00100000:0.0:1787787075.868176:0:7935:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787787075.868183:0:7935:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9870d4e630c0 x1874630503579648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787075.868197:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7935:1874630503579648:0@lo:1000: 00000100:00100000:0.0:1787787075.868222:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787075.868301:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1556b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787075.868367:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503579648 00000100:00100000:1.0:1787787075.868371:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503579648 00000100:00100000:1.0:1787787075.868398:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787075.868405:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7935:x1874630503579648:12345-0@lo:1000: 00000040:00080000:3.0:1787787075.870065:0:7938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787787075.870158:0:7938:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787787075.870169:0:7938:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1787787075.886966:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787787075.887396:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7935:x1874630503579648:12345-0@lo:1000: Request processed in 18987us (19168us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787787075.887418:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1787787075.887808:0:7935:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787787075.887814:0:7935:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787787075.887832:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7935:1874630503579648:0@lo:1000: 00010000:00010000:1.0:1787787076.394321:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787076.457644:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d96461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503579776:0@lo:41: 00000100:00100000:2.0:1787787076.457717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787076.457844:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503579776 00000100:00100000:0.0:1787787076.457852:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503579776 00000100:00100000:0.0:1787787076.457912:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787076.457921:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503579776:12345-0@lo:41: 00000004:00000024:0.0:1787787076.457956:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787787076.458018:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503579776:12345-0@lo:41: Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787076.458027:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787076.458219:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d96461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503579776:0@lo:41: 00010000:00010000:1.0:1787787077.418701:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787078.444535:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787079.465721:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787080.489399:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787081.065547:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d96461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503580160:0@lo:400: 00000100:00100000:3.0:1787787081.065570:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503580288:0@lo:400: 00000100:00100000:1.0:1787787081.065617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787081.065625:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787081.065682:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580160 00000100:00100000:2.0:1787787081.065692:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503580032:0@lo:41: 00000100:00100000:0.0:1787787081.065692:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580160 00000100:00100000:0.0:1787787081.065751:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787081.065762:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503580160:12345-0@lo:400: 00000100:00100000:3.0:1787787081.066896:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787081.066909:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503580416:0@lo:400: 00000100:00100000:3.0:1787787081.066951:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787081.067045:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580416 00000100:00100000:1.0:1787787081.067051:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580416 00000100:00100000:1.0:1787787081.067095:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787081.067104:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503580416:12345-0@lo:400: 00000100:00100000:1.0:1787787081.067163:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503580416:12345-0@lo:400: Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787081.067182:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787081.068094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787081.068130:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503579904:0@lo:400: 00000100:00100000:2.0:1787787081.068177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787081.068205:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503580544:0@lo:400: 00000100:00100000:2.0:1787787081.068226:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787081.068373:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580288 00000100:00100000:1.0:1787787081.068379:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580288 00000100:00100000:1.0:1787787081.068403:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580032 00000100:00100000:1.0:1787787081.068405:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580032 00000100:00100000:1.0:1787787081.068470:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580544 00000100:00100000:1.0:1787787081.068473:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580544 00000100:00100000:1.0:1787787081.068485:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787081.068492:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503580288:12345-0@lo:400: 00000100:00100000:1.0:1787787081.068535:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503580288:12345-0@lo:400: Request processed in 43us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787081.068542:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787081.068556:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787081.068563:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503580032:12345-0@lo:41: 00000004:00000024:1.0:1787787081.068592:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00010000:00080000:3.0:1787787081.068597:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc304780 x1874630503580416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787081.068612:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503580416:0@lo:400: 00000100:00100000:1.0:1787787081.068639:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503580032:12345-0@lo:41: Request processed in 75us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787081.068646:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503580288:0@lo:400: 00000100:00100000:1.0:1787787081.068648:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787081.068666:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787081.068674:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503580544:12345-0@lo:400: 00000100:00100000:1.0:1787787081.068701:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503580544:12345-0@lo:400: Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787081.068707:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787787081.068973:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503580032:0@lo:41: 00000100:00100000:2.0:1787787081.068995:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503580544:0@lo:400: 00000100:00100000:0.0:1787787081.069348:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503580160:12345-0@lo:400: Request processed in 3587us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787081.069373:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787081.069411:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503579904 00000100:00100000:0.0:1787787081.069416:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503579904 00000100:00100000:0.0:1787787081.069460:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787081.069468:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:3653:x1874630503579904:12345-0@lo:400: 00010000:00080000:1.0:1787787081.069677:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870d96461c0 x1874630503580160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787081.069691:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d96461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503580160:0@lo:400: 00000100:00100000:0.0:1787787081.069759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:3653:x1874630503579904:12345-0@lo:400: Request processed in 291us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787081.069765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787787081.069838:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503579904:0@lo:400: 00010000:00010000:2.0:1787787081.514376:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787081.580383:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503580672:0@lo:41: 00000100:00100000:2.0:1787787081.580470:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787081.580548:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580672 00000100:00100000:2.0:1787787081.580555:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580672 00000100:00100000:2.0:1787787081.580598:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787081.580608:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503580672:12345-0@lo:41: 00000004:00000024:2.0:1787787081.580642:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787787081.580688:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503580672:12345-0@lo:41: Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787081.580694:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787081.580736:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503580672:0@lo:41: 00010000:00010000:1.0:1787787082.538026:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787083.566852:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787084.588489:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787084.682430:0:8434:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787084.682435:0:8434:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787787084.682436:0:8434:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787787084.682925:0:8434:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870fc17b800 00000020:01000004:3.0:1787787084.682941:0:8434:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787787084.682953:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787787084.682967:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9870f55f4d28) 00000020:00000080:3.0:1787787084.682983:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787787084.727018:0:8434:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787787084.727067:0:8434:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787787084.756694:0:8434:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787787084.756920:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787787084.756932:0:8434:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787787084.756943:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x11620bc3f30a8a55 00000020:01000004:2.0:1787787084.756950:0:8434:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787787084.756971:0:8434:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787787084.756974:0:8434:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787787084.756979:0:8434:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787787084.756984:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787787084.756993:0:8434:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff987101db3370) 00000020:00000080:2.0:1787787084.757005:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787787084.758387:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787084.758559:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787787084.758565:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787787084.760905:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787787084.760919:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787787084.761275:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787787084.761281:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787787084.763388:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787084.763655:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787787084.763661:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787787084.765206:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787787084.765218:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787787084.784987:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787084.785311:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787084.785319:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787787084.787537:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787787084.787551:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787787084.792532:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787787084.792547:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787787084.798261:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787084.798659:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787787084.798665:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787787084.800162:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787787084.800174:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787787084.855996:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787084.856537:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787787084.856555:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787787084.858243:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787787084.858255:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787787084.859077:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787787084.859109:0:8434:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787787084.859116:0:8434:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787787084.878525:0:8434:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787787084.881821:0:8434:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.131@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787787084.881830:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787787084.881843:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787084.881845:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787084.881846:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787084.881847:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787084.881849:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787084.881850:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787084.881851:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787084.881853:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787084.881854:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787084.881856:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787084.881860:0:8434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787787084.881863:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787084.881864:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787084.881865:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787084.881866:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787084.881868:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787084.881869:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787084.881870:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787084.881871:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787084.881872:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787084.881873:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787084.881874:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787084.881906:0:8434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787787084.881926:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503580800:0@lo:253: 00000100:00100000:0.0:1787787084.882008:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.882134:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101f773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787084.883672:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580800 00000100:00100000:2.0:1787787084.883687:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580800 00000100:00100000:2.0:1787787084.883764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787084.883774:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:8434:x1874630503580800:12345-0@lo:253: 20000000:01000000:2.0:1787787084.883919:0:6520:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787787084.883924:0:6520:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787787084.884290:0:6520:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787787084.884295:0:6520:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787787084.884615:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787084.884781:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787787084.884923:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787787084.884945:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787787084.884968:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787787084.884985:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787787084.885002:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787787084.885406:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787787084.885424:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.131@tcp 20000000:01000000:2.0:1787787084.885427:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787787084.885441:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787787084.885447:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787787084.885461:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787787084.885466:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:2.0:1787787084.885494:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787787084.885502:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787787084.885514:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787787084.885527:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787787084.885599:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787787084.885610:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.131@tcp 20000000:01000000:2.0:1787787084.885612:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787787084.885626:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787787084.885631:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787787084.885644:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787787084.885650:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:2.0:1787787084.885663:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787787084.885669:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787787084.885680:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787787084.885694:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787787084.886686:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787787084.886707:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.131@tcp 20000000:01000000:2.0:1787787084.886709:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:2.0:1787787084.886737:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787787084.886743:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787787084.886756:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787787084.886774:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:2.0:1787787084.886920:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787787084.886931:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787787084.886949:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787787084.886965:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787787084.886979:0:6520:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787787084.886982:0:6520:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787787084.886986:0:6520:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787787084.887029:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787787084.887032:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787084.889215:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787084.889267:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787084.889286:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787787084.895447:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1787787084.895501:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1787787084.895522:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1787787084.895539:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787787084.896322:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787787084.896898:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787787084.896941:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787787084.896961:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787787084.897200:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787787084.897224:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787787084.897242:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787787084.897255:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787787084.897257:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787787084.897861:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787787084.898010:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787787084.898034:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787787084.898049:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787787084.898059:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787787084.898061:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787084.898951:0:8457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787084.898985:0:8457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787084.899004:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1787787084.903487:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1787787084.903522:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1787787084.903536:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1787787084.903565:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787787084.903585:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903604:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903611:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a899f expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903618:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903625:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903631:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903638:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903674:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903728:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 18 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.903743:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503580928:0@lo:104: 00000100:00100000:3.0:1787787084.903806:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787084.903859:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903867:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 18 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.903875:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581056:0@lo:104: 00000100:00100000:3.0:1787787084.903893:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787084.903923:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903931:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 18 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.903939:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581184:0@lo:104: 00000100:00100000:3.0:1787787084.903971:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787084.903986:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a899f expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.903995:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a899f expref: 18 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.904003:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581312:0@lo:104: 00000100:00100000:3.0:1787787084.904028:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787084.904046:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.904055:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 18 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.904063:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581440:0@lo:104: 00000100:00100000:3.0:1787787084.904101:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787084.904114:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.904303:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503580928 00000100:00100000:0.0:1787787084.904310:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503580928 00000100:00100000:0.0:1787787084.904348:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581056 00000100:00100000:0.0:1787787084.904352:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581056 00000100:00100000:0.0:1787787084.904364:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581184 00000100:00100000:0.0:1787787084.904367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581184 00000100:00100000:0.0:1787787084.904376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581312 00000100:00100000:0.0:1787787084.904378:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581312 00000100:00100000:0.0:1787787084.904386:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581440 00000100:00100000:0.0:1787787084.904388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581440 00000100:00100000:0.0:1787787084.904401:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787084.904409:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+7:6520:x1874630503580928:12345-0@lo:104: 00010000:00010000:0.0:1787787084.904421:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.904481:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787084.904488:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+7:6520:x1874630503580928:12345-0@lo:104: Request processed in 80us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.904496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787084.904512:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787084.904518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+6:6520:x1874630503581056:12345-0@lo:104: 00010000:00010000:0.0:1787787084.904526:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.904569:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787084.904575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+6:6520:x1874630503581056:12345-0@lo:104: Request processed in 57us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.904581:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787084.904593:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787084.904599:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+5:6520:x1874630503581184:12345-0@lo:104: 00010000:00010000:0.0:1787787084.904614:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.904643:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787787084.904648:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+5:6520:x1874630503581184:12345-0@lo:104: Request processed in 50us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.904655:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787084.904669:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787084.904675:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:6520:x1874630503581312:12345-0@lo:104: 00010000:00010000:0.0:1787787084.904683:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.904709:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787787084.904727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:6520:x1874630503581312:12345-0@lo:104: Request processed in 53us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.904733:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787084.904746:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787084.904752:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6520:x1874630503581440:12345-0@lo:104: 00010000:00010000:0.0:1787787084.904760:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.904786:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787787084.904791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6520:x1874630503581440:12345-0@lo:104: Request processed in 40us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.904797:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787084.904922:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503580928:0@lo:104: 00000100:00100000:3.0:1787787084.904932:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581056:0@lo:104: 00000100:00100000:3.0:1787787084.904940:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581184:0@lo:104: 00000100:00100000:3.0:1787787084.904946:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581312:0@lo:104: 00000100:00100000:3.0:1787787084.904953:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503581440:0@lo:104: 00010000:00010000:3.0:1787787084.904976:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905050:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787787084.905058:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905065:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787084.905069:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905078:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787084.905086:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787084.905093:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787084.905134:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905166:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787084.905204:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905212:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14a00/0x11620bc3f30a8a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905227:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787787084.905230:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905237:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787084.905239:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905246:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787084.905252:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787084.905258:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787084.905273:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905279:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787084.905284:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905291:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a0f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905302:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787787084.905312:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905318:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787084.905321:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905328:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787084.905334:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787084.905339:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787084.905353:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905359:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787084.905375:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905382:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c7e00/0x11620bc3f30a89ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905392:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787084.905396:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905402:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787084.905405:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905422:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787084.905429:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787084.905434:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787084.905449:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905455:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787084.905460:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905466:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a899f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89a6 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905476:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787084.905479:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905484:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787084.905487:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905493:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787084.905498:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787084.905509:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787084.905522:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905528:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787084.905532:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905551:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a892f expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.905566:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787084.905568:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787084.905570:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787084.905578:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787084.905591:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503581696:0@lo:103: 00000100:00100000:1.0:1787787084.905636:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.905670:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787787084.905676:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503581568:0@lo:103: 00000100:00100000:1.0:1787787084.905696:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.905709:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503582080:0@lo:103: 00000100:00100000:1.0:1787787084.905739:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.905761:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503581952:0@lo:103: 00000100:00100000:1.0:1787787084.905782:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.905794:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787084.905798:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503581824:0@lo:103: 00000100:00100000:1.0:1787787084.905816:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787084.906219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581696 00000100:00100000:3.0:1787787084.906225:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581696 00010000:00010000:3.0:1787787084.906249:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 19 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.906267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581568 00000100:00100000:3.0:1787787084.906269:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581568 00010000:00010000:3.0:1787787084.906278:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 20 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.906287:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582080 00000100:00100000:3.0:1787787084.906296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582080 00010000:00010000:3.0:1787787084.906309:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 21 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.906320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581952 00000100:00100000:3.0:1787787084.906323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581952 00010000:00010000:3.0:1787787084.906332:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a899f expref: 22 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.906341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503581824 00000100:00100000:3.0:1787787084.906343:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503581824 00010000:00010000:3.0:1787787084.906353:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 23 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787084.906366:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787084.906373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+23:3656:x1874630503581696:12345-0@lo:103: 00010000:00010000:3.0:1787787084.906386:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787084.906390:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 23 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906400:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 23 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906413:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8a08 expref: 23 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906426:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787084.906463:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+22:3656:x1874630503581696:12345-0@lo:103: Request processed in 90us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.906469:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787084.906483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787084.906501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+21:3656:x1874630503581568:12345-0@lo:103: 00010000:00010000:3.0:1787787084.906508:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787084.906512:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 21 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906521:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 21 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906531:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a8a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8a40 expref: 21 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906549:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787084.906574:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+20:3656:x1874630503581568:12345-0@lo:103: Request processed in 75us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.906579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787084.906591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787084.906597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+19:3656:x1874630503582080:12345-0@lo:103: 00010000:00010000:3.0:1787787084.906605:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787084.906609:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 19 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906616:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 19 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906624:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a892f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8928 expref: 19 pid: 6520 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906632:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787084.906651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+18:3656:x1874630503582080:12345-0@lo:103: Request processed in 55us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.906665:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787084.906677:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787084.906681:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+17:3654:x1874630503581952:12345-0@lo:103: 00010000:00010000:3.0:1787787084.906688:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787084.906692:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a899f expref: 17 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906699:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a899f expref: 17 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906708:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c7000/0x11620bc3f30a89a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a899f expref: 17 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906729:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787084.906764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+16:3654:x1874630503581952:12345-0@lo:103: Request processed in 83us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.906771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787084.906782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787084.906788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3641450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+15:3654:x1874630503581824:12345-0@lo:103: 00010000:00010000:3.0:1787787084.906795:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787084.906800:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 15 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906809:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 15 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906819:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391200/0x11620bc3f30a89f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a89ec expref: 15 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906841:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906849:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906862:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906869:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906875:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906882:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906887:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787084.906891:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906898:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906915:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787084.906924:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787084.906948:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3641450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+14:3654:x1874630503581824:12345-0@lo:103: Request processed in 160us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.906961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787084.907129:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503581824:0@lo:103: 00000100:00100000:2.0:1787787084.907167:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503581952:0@lo:103: 00010000:00010000:0.0:1787787084.907253:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.907271:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.907277:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c7800/0x11620bc3f30a8a63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787787084.907290:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787787084.907803:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503581568:0@lo:103: 00000100:00100000:1.0:1787787084.907811:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503582080:0@lo:103: 00000100:00100000:1.0:1787787084.907818:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503581696:0@lo:103: 00000100:00100000:0.0:1787787084.909811:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+13:8434:x1874630503580800:12345-0@lo:253: Request processed in 26030us (27795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.909824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787084.910086:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503580800:0@lo:253: 10000000:01000000:2.0:1787787084.910102:0:8434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787787084.910105:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787084.910107:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787084.910108:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787084.910110:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787787084.910111:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787084.910112:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787084.910114:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787084.910115:0:8434:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787787084.910117:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787084.910118:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787787084.910165:0:8434:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870fc17b800 from lustre-OST0000 10000000:01000000:2.0:1787787084.910200:0:8434:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787787084.910203:0:8434:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787787084.910212:0:8434:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9870d15599b8 local copy 10000000:01000000:2.0:1787787084.910216:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787787084.910251:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.910276:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.910286:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787084.910304:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582208:0@lo:101: 00000100:00100000:2.0:1787787084.910341:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787084.910378:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0076840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.910561:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582208 00000100:00100000:0.0:1787787084.910567:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582208 00000100:00100000:0.0:1787787084.910613:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787787084.910621:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+13:8434:x1874630503582208:12345-0@lo:101: 00010000:00010000:0.0:1787787084.910634:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787084.910647:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8a6a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.910670:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8a6a expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.910681:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a6a expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.910689:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15c00, rc 0) 00000100:00100000:0.0:1787787084.910737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:8434:x1874630503582208:12345-0@lo:101: Request processed in 117us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.910743:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787787084.911272:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582208:0@lo:101: 00010000:00010000:2.0:1787787084.911285:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.911293:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787084.911377:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582336:0@lo:501: 00000100:00100000:2.0:1787787084.911408:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787084.911439:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0076840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.911451:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582336 00000100:00100000:0.0:1787787084.911456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582336 00000100:00100000:0.0:1787787084.911490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787787084.911497:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:8434:x1874630503582336:12345-0@lo:501: 00000100:00100000:0.0:1787787084.911574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:8434:x1874630503582336:12345-0@lo:501: Request processed in 77us (163us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787084.911581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787084.911706:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582336:0@lo:501: 10000000:01000000:1.0:1787787084.911732:0:8434:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787787084.911751:0:8434:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787787084.911756:0:8434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.911764:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.911776:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.911801:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787787084.911833:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870fc17b800 10000000:01000000:1.0:1787787084.911841:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787787084.911847:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787787084.911849:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787084.911854:0:8434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787787084.911859:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787084.911876:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.911884:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.911909:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787084.911922:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582464:0@lo:101: 00000100:00100000:1.0:1787787084.911958:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.911981:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11180 going to sleep for 11 seconds 00010000:00010000:2.0:1787787084.912036:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787084.912042:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.912049:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787084.912053:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.912061:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787084.912074:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787084.912080:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787084.912100:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.912106:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787787084.912175:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787787084.912277:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.912286:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c1391800/0x11620bc3f30a8a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8a71 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.912299:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787084.912300:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787084.912302:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787084.912393:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582464 00000100:00100000:0.0:1787787084.912398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582464 00000100:00100000:0.0:1787787084.912434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787787084.912440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:8434:x1874630503582464:12345-0@lo:101: 00010000:00010000:0.0:1787787084.912450:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787084.912461:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8a78 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.912477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.912486:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.912493:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14a00, rc 0) 00000100:00100000:0.0:1787787084.912532:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582464:12345-0@lo:101: Request processed in 92us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.912539:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787084.912665:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582464:0@lo:101: 00010000:00010000:1.0:1787787084.912676:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.912684:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787084.912754:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582720:0@lo:501: 00000100:00100000:1.0:1787787084.912781:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.912807:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787084.912851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582720 00000100:00100000:2.0:1787787084.912855:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582720 00000100:00100000:2.0:1787787084.912889:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787787084.912896:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582720:12345-0@lo:501: 00000100:00100000:2.0:1787787084.912990:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582720:12345-0@lo:501: Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787084.912997:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787787084.913063:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582720:0@lo:501: 00000100:00100000:1.0:1787787084.913088:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582848:0@lo:503: 00000100:00100000:1.0:1787787084.913130:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.913185:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.913264:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582848 00000100:00100000:0.0:1787787084.913268:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582848 00000100:00100000:0.0:1787787084.913290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787787084.913297:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582848:12345-0@lo:503: 00000100:00100000:0.0:1787787084.913378:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582848:12345-0@lo:503: Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.913385:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787787084.913468:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582848:0@lo:503: 00000040:00080000:1.0:1787787084.913737:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787084.913809:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582976:0@lo:502: 00000100:00100000:1.0:1787787084.913844:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.913876:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.914232:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582976 00000100:00100000:0.0:1787787084.914237:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582976 00000100:00100000:0.0:1787787084.914262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787787084.914268:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582976:12345-0@lo:502: 00000100:00100000:0.0:1787787084.914349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503582976:12345-0@lo:502: Request processed in 80us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.914356:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787084.914670:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503582976:0@lo:502: 00000040:00080000:1.0:1787787084.914895:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787787084.914924:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787787084.914939:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787787084.914952:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787787084.914967:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787787084.914982:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787787084.915003:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583104:0@lo:502: 00000100:00100000:1.0:1787787084.915041:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.915073:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.915119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583104 00000100:00100000:0.0:1787787084.915124:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583104 00000100:00100000:0.0:1787787084.915183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787084.915190:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583104:12345-0@lo:502: 00000100:00100000:0.0:1787787084.915255:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583104:12345-0@lo:502: Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.915262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787084.915351:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583104:0@lo:502: 00000040:00080000:1.0:1787787084.915385:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787787084.915392:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787787084.915915:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787084.915924:0:8458:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787787084.915930:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787084.915932:0:8458:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787787084.915937:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787084.915952:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9870f5778000) 00000020:00000080:0.0:1787787084.915972:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787787084.915977:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787084.916071:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc17b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787787084.916079:0:8458:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787084.916085:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x11620bc3f30a8a8d 00000100:00100000:3.0:1787787084.916666:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503582592:0@lo:103: 00000100:00100000:3.0:1787787084.916724:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787084.916815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503582592 00000100:00100000:2.0:1787787084.916821:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503582592 00000100:00100000:2.0:1787787084.916869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787084.916878:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+15:3655:x1874630503582592:12345-0@lo:103: 00010000:00010000:2.0:1787787084.916900:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787084.916919:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8a6a expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.916934:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787084.916984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+14:3655:x1874630503582592:12345-0@lo:103: Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787084.916990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787084.917091:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503582592:0@lo:103: 00010000:00010000:0.0:1787787084.921833:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1787787084.922498:0:8458:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787787084.925736:0:8458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787787084.926431:0:8458:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787787084.932586:0:8458:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787787084.932797:0:8458:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787787084.947386:0:8458:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787787084.949075:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787787084.949090:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787084.949096:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787084.949099:0:8458:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787787084.949102:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787084.949106:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787084.949108:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787787084.949111:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787787084.949113:0:8458:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787787084.949178:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787084.949182:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787084.949183:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787787084.949187:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787787084.949346:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787787084.949377:0:8434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787787084.949400:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.949412:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787084.949420:0:8434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc17b800 from 1 10000000:01000000:0.0:1787787084.949422:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787084.949454:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.949462:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.949472:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787084.949494:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583232:0@lo:101: 00000100:00100000:0.0:1787787084.949567:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.949604:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787084.949848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583232 00000100:00100000:1.0:1787787084.949856:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583232 00000100:00100000:1.0:1787787084.953424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787787084.953442:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:8434:x1874630503583232:12345-0@lo:101: 00010000:00010000:1.0:1787787084.953460:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787084.953480:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8a94 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.953508:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.953519:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.953528:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5400, rc 0) 00000100:00100000:1.0:1787787084.953608:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583232:12345-0@lo:101: Request processed in 172us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.953615:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787787084.956376:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583232:0@lo:101: 00010000:00010000:0.0:1787787084.956405:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.956418:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787084.956535:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583360:0@lo:501: 00000100:00100000:0.0:1787787084.956618:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.956659:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787084.956818:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583360 00000100:00100000:2.0:1787787084.956824:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583360 00000100:00100000:2.0:1787787084.956874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787787084.956884:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583360:12345-0@lo:501: 00000100:00100000:2.0:1787787084.956994:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583360:12345-0@lo:501: Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787084.957002:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787787084.957583:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583360:0@lo:501: 00000100:00100000:0.0:1787787084.957620:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583488:0@lo:503: 00000100:00100000:0.0:1787787084.957668:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.957694:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.957723:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583488 00000100:00100000:0.0:1787787084.957728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583488 00000100:00100000:0.0:1787787084.957754:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787787084.957769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583488:12345-0@lo:503: 00000100:00100000:0.0:1787787084.957877:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583488:12345-0@lo:503: Request processed in 115us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.957884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787787084.957925:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583488:0@lo:503: 00000040:00080000:0.0:1787787084.958166:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787084.958224:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583616:0@lo:502: 00000100:00100000:0.0:1787787084.958259:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.958274:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.958289:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583616 00000100:00100000:0.0:1787787084.958292:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583616 00000100:00100000:0.0:1787787084.958309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787084.958314:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583616:12345-0@lo:502: 00000100:00100000:0.0:1787787084.958381:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583616:12345-0@lo:502: Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.958388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787084.958422:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583616:0@lo:502: 00000040:00080000:0.0:1787787084.958605:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787787084.958630:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787787084.958648:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583744:0@lo:502: 00000100:00100000:0.0:1787787084.958680:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.958694:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.958706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583744 00000100:00100000:0.0:1787787084.958709:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583744 00000100:00100000:0.0:1787787084.958740:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787084.958746:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583744:12345-0@lo:502: 00000100:00100000:0.0:1787787084.958812:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583744:12345-0@lo:502: Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787084.958819:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787084.958858:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583744:0@lo:502: 00000040:00080000:0.0:1787787084.958894:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787787084.958902:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787787084.961046:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787084.961068:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787084.961071:0:8462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787787084.961080:0:8462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870fc17b800 00000020:00000080:1.0:1787787084.961082:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787787084.961095:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787084.961098:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787084.961099:0:8462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787787084.961102:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787787084.961926:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787787084.961961:0:8434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787084.961987:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.962001:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787084.962054:0:8434:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787787084.962058:0:8434:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870fc17b800 10000000:01000000:0.0:1787787084.962061:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870fc17b800 10000000:01000000:0.0:1787787084.962066:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787084.962072:0:8434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870fc17b800 from 1 10000000:01000000:0.0:1787787084.962084:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787787084.962120:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.962128:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787084.962314:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787084.962340:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583872:0@lo:101: 00000100:00100000:0.0:1787787084.962412:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787084.962456:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787084.963666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503583872 00000100:00100000:1.0:1787787084.963677:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503583872 00000100:00100000:1.0:1787787084.963752:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787787084.963772:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:8434:x1874630503583872:12345-0@lo:101: 00010000:00010000:1.0:1787787084.963789:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787084.963805:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8aa2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.963833:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.963844:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.963852:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5000, rc 0) 00000100:00100000:1.0:1787787084.963918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503583872:12345-0@lo:101: Request processed in 157us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.963926:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787787084.963982:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503583872:0@lo:101: 00010000:00010000:1.0:1787787084.963998:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787084.964006:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787084.964102:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584000:0@lo:501: 00000100:00100000:1.0:1787787084.964131:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.964182:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1556b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787084.964212:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584000 00000100:00100000:1.0:1787787084.964224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584000 00000100:00100000:1.0:1787787084.964251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787084.964257:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584000:12345-0@lo:501: 00000100:00100000:1.0:1787787084.964350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584000:12345-0@lo:501: Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.964357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787084.964389:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584000:0@lo:501: 00000100:00100000:1.0:1787787084.964413:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584128:0@lo:503: 00000100:00100000:1.0:1787787084.964449:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.964461:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1556b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787084.964473:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584128 00000100:00100000:1.0:1787787084.964477:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584128 00000100:00100000:1.0:1787787084.964494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787787084.964499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584128:12345-0@lo:503: 00000100:00100000:1.0:1787787084.964583:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584128:12345-0@lo:503: Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.964589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787787084.964624:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584128:0@lo:503: 00000040:00080000:1.0:1787787084.964857:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787084.964930:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584256:0@lo:502: 00000100:00100000:1.0:1787787084.964968:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.964983:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787084.964999:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584256 00000100:00100000:1.0:1787787084.965003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584256 00000100:00100000:1.0:1787787084.965022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787787084.965027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584256:12345-0@lo:502: 00000100:00100000:1.0:1787787084.967345:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584256:12345-0@lo:502: Request processed in 2308us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.967360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787787084.967458:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584256:0@lo:502: 00000040:00080000:1.0:1787787084.968637:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787787084.968678:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787787084.968696:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787787084.968722:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787787084.968740:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787787084.968755:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787787084.968951:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787787084.968971:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787787084.968986:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787787084.969000:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787787084.969015:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787787084.969029:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787787084.969042:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787787084.969056:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787787084.969073:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787787084.969106:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787787084.969125:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787787084.969176:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787787084.969196:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787787084.969211:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787787084.969225:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787787084.969240:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787787084.969254:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787787084.969269:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787787084.969284:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787787084.969299:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787787084.969321:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787787084.969348:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787787084.969364:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787787084.969378:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787787084.969392:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787787084.969422:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787787084.969440:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787787084.969454:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787787084.969468:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787787084.969482:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787787084.969497:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787787084.971841:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584384:0@lo:502: 00000100:00100000:1.0:1787787084.971937:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.971988:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787084.972066:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584384 00000100:00100000:2.0:1787787084.972074:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584384 00000100:00100000:2.0:1787787084.972125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787787084.972135:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584384:12345-0@lo:502: 00000100:00100000:2.0:1787787084.972302:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503584384:12345-0@lo:502: Request processed in 168us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787084.972311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787787084.972426:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503584384:0@lo:502: 00000040:00080000:0.0:1787787084.972508:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787787084.972522:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787787084.973462:0:8463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787787084.973481:0:8463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9870f458b370) 00000020:00000080:1.0:1787787084.973505:0:8463:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787787084.973663:0:8463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc17b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787787084.973667:0:8463:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc17b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787787084.973670:0:8463:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc17b800 3 00010000:00080000:1.0:1787787084.973699:0:8463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc2761000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787084.976967:0:8463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1787787084.981735:0:8463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787787084.981869:0:8463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787084.981884:0:8463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x11620bc3f30a8ab7 00000100:00080000:1.0:1787787084.981895:0:8463:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787084.981902:0:8463:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc2761000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787084.981944:0:8463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3052c0 x1874630503584512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787084.981981:0:8463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787787084.982080:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503584768:0@lo:400: 00000100:00100000:1.0:1787787084.982187:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.982225:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787084.982233:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503584640:0@lo:400: 00000100:00100000:1.0:1787787084.982258:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.982285:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503584896:0@lo:400: 00000100:00100000:1.0:1787787084.982306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.982322:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787084.982326:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503585024:0@lo:400: 00000100:00100000:1.0:1787787084.982345:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787084.982380:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584768 00000100:00100000:1.0:1787787084.982386:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584768 00000100:00100000:1.0:1787787084.982415:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585024 00000100:00100000:1.0:1787787084.982418:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585024 00000100:00100000:1.0:1787787084.982433:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787084.982441:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503584768:12345-0@lo:400: 00000100:00100000:1.0:1787787084.982493:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503584768:12345-0@lo:400: Request processed in 52us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.982500:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787084.982514:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787084.982520:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503585024:12345-0@lo:400: 00000100:00100000:3.0:1787787084.982646:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503584512:0@lo:38: 00000100:00100000:3.0:1787787084.982677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787084.982732:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584640 00000100:00100000:3.0:1787787084.982736:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584640 00000100:00100000:3.0:1787787084.982778:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584896 00000100:00100000:3.0:1787787084.982782:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584896 00000100:00100000:3.0:1787787084.982793:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503584512 00000100:00100000:3.0:1787787084.982796:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503584512 00000100:00100000:3.0:1787787084.982806:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787084.982812:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503584640:12345-0@lo:400: 00000100:00100000:3.0:1787787084.982840:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503584640:12345-0@lo:400: Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.982845:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787084.982855:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787084.982860:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503584896:12345-0@lo:400: 00000100:00100000:3.0:1787787084.982884:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503584896:12345-0@lo:400: Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.982889:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787084.982898:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787084.982902:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874630503584512:12345-0@lo:38: 00010000:00080000:3.0:1787787084.982920:0:7753:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1787787084.982946:0:7753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x11620bc3f30a8abe 00000004:00100000:3.0:1787787084.982965:0:7753:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787084.982993:0:7753:0:(import.c:65:import_set_state_nolock()) ffff9870f4597800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787084.983027:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874630503584512:12345-0@lo:38: Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787084.983033:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787787084.983078:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc3052c0 x1874630503584512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787084.983089:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787084.983097:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787787084.983105:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787787084.983109:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787787084.983112:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787084.983117:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503584512:0@lo:38: 00010000:00080000:3.0:1787787084.983167:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc3070c0 x1874630503584896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787084.983177:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503584896:0@lo:400: 00000100:00100000:1.0:1787787084.984742:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503585024:12345-0@lo:400: Request processed in 2214us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787084.984755:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787787084.985447:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc307c00 x1874630503584640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787084.985464:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503584640:0@lo:400: 00000100:00100000:1.0:1787787084.985496:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503584768:0@lo:400: 00000100:00100000:3.0:1787787084.985844:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503585024:0@lo:400: 00000020:01000004:2.0:1787787084.989752:0:8463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787787084.990042:0:8463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff987101db0000) 00000020:00000080:2.0:1787787084.990068:0:8463:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787787084.990624:0:8463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc17b800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787084.990630:0:8463:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc17b800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787084.990632:0:8463:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc17b800 3 00010000:00080000:2.0:1787787084.990676:0:8463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870df558000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.131@tcp at head 00010000:00010000:2.0:1787787084.993004:0:8463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787787084.993304:0:8463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787787084.993346:0:8463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787084.993360:0:8463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x11620bc3f30a8acc 00000100:00080000:2.0:1787787084.993372:0:8463:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787084.993379:0:8463:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9870df558000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787084.993416:0:8463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3b3840 x1874630503585152/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787084.993441:0:8463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1787787084.993833:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1787787084.993963:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787787084.993990:0:8434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787787084.994009:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787084.994019:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787787084.994058:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787787084.994060:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787084.994061:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787084.994063:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787084.994064:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787084.994065:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787084.994066:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787084.994068:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787084.994069:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787084.994071:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787084.994072:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787084.994076:0:8434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787787084.994078:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787084.994079:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787084.994084:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787084.994085:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787084.994086:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787084.994087:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787084.994088:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787084.994089:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787084.994090:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787084.994091:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787084.994092:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787084.994105:0:8434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787787084.994118:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503585280:0@lo:253: 00000100:00100000:2.0:1787787084.994214:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787084.994244:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0076d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787084.994434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585280 00000100:00100000:0.0:1787787084.994440:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585280 00000100:00100000:0.0:1787787084.994481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787084.994489:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503585280:12345-0@lo:253: 20000000:01000000:0.0:1787787084.994512:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787787084.994523:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787787084.994750:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503585152:0@lo:38: 00000100:00100000:0.0:1787787084.994795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787084.994856:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585152 00000100:00100000:2.0:1787787084.994860:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585152 00000100:00100000:2.0:1787787084.994885:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787084.994890:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874630503585152:12345-0@lo:38: 00010000:00080000:2.0:1787787084.994910:0:7753:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1787787084.994950:0:7753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x11620bc3f30a8ad3 00000004:00100000:2.0:1787787084.994963:0:7753:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787084.994991:0:7753:0:(import.c:65:import_set_state_nolock()) ffff9870f3607800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787084.995042:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874630503585152:12345-0@lo:38: Request processed in 150us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787084.995048:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787787084.995112:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc3b3840 x1874630503585152/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787084.995122:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787084.995130:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787787084.995163:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787787084.995167:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787787084.995169:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870df558000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787787084.995174:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503585152:0@lo:38: 20000000:01000000:3.0:1787787085.005666:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787085.005686:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787787085.008982:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:8434:x1874630503585280:12345-0@lo:253: Request processed in 14483us (14757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787085.008996:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787787085.009063:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:8434:1874630503585280:0@lo:253: 10000000:01000000:3.0:1787787085.009079:0:8434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787787085.009082:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787085.009099:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787085.009100:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787085.009102:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787085.009103:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787085.009104:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787085.009105:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787085.009107:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787085.009108:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787085.009110:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787085.009111:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787085.009167:0:8434:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787787085.009877:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787787085.009883:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787787085.009907:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787085.009924:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787085.009941:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787085.009948:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787085.009986:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787085.009999:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 15 pid: 6519 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787085.010012:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503585408:0@lo:104: 00000100:00100000:0.0:1787787085.010058:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787085.010126:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787085.010134:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 15 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787085.010165:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503585536:0@lo:104: 00000100:00100000:0.0:1787787085.010186:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787085.010467:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787787085.010487:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787085.010511:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585408 00000100:00100000:1.0:1787787085.010517:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585408 00000100:00100000:1.0:1787787085.010554:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585536 00000100:00100000:1.0:1787787085.010558:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585536 00000100:00100000:1.0:1787787085.010572:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787085.010580:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:6543:x1874630503585408:12345-0@lo:104: 00010000:00010000:1.0:1787787085.010593:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010642:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787085.010648:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:6543:x1874630503585408:12345-0@lo:104: Request processed in 69us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787085.010654:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787085.010690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787085.010696:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503585536:12345-0@lo:104: 00010000:00010000:1.0:1787787085.010722:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010756:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787085.010761:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503585536:12345-0@lo:104: Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787085.010779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787787085.010801:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787085.010806:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010813:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787085.010818:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010826:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787085.010833:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787085.010838:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787085.010864:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010871:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787085.010890:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010897:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a89fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010913:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787085.010917:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010922:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787085.010925:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010931:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787085.010937:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787085.010942:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787085.010954:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010960:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787085.010965:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010971:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a89d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.010982:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787085.010984:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787085.010985:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787085.010991:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787085.011014:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503585792:0@lo:103: 00000100:00100000:1.0:1787787085.011044:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787085.011065:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787085.011071:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503585664:0@lo:103: 00000100:00100000:1.0:1787787085.011093:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787085.011119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585792 00000100:00100000:1.0:1787787085.011123:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585792 00010000:00010000:1.0:1787787085.011166:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 16 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787085.011187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585664 00000100:00100000:1.0:1787787085.011190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585664 00010000:00010000:1.0:1787787085.011201:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 17 pid: 6519 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787085.011214:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787085.011219:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+17:3654:x1874630503585792:12345-0@lo:103: 00010000:00010000:1.0:1787787085.011229:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787085.011234:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 17 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011243:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 17 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011257:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787085.011284:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+17:3654:x1874630503585792:12345-0@lo:103: Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787085.011290:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787085.011302:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787085.011308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+16:3654:x1874630503585664:12345-0@lo:103: 00010000:00010000:1.0:1787787085.011321:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787085.011325:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 16 pid: 6519 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011335:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 16 pid: 6519 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011346:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011353:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787085.011365:0:6514:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009993751s 00010000:00010000:1.0:1787787085.011369:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011377:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011383:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011389:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011394:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787085.011398:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011405:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011418:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011427:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787085.011449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+16:3654:x1874630503585664:12345-0@lo:103: Request processed in 141us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787085.011455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787787085.011486:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a89fa expref: 15 pid: 6519 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787085.011496:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503585408:0@lo:104: 00010000:00010000:1.0:1787787085.011506:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a89d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a89d0 expref: 14 pid: 6522 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787085.011514:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503585536:0@lo:104: 00010000:00010000:1.0:1787787085.011533:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011542:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011547:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787085.011553:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8ada lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787085.011579:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503585664:0@lo:103: 00000100:00100000:1.0:1787787085.011597:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503585792:0@lo:103: 00080000:10000000:3.0:1787787085.018832:0:8434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787787085.019000:0:8434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787787085.019221:0:8434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787787085.019377:0:8434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787787085.019580:0:8434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787787085.019848:0:8434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787787085.021770:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787787085.032349:0:8434:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787787085.032359:0:8434:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787787085.032461:0:8434:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787787085.032498:0:8434:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787787085.032520:0:8434:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787787085.032538:0:8434:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787787085.033253:0:8434:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787085.033416:0:8434:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787787085.611251:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787787085.976481:0:8519:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787085.981806:0:8519:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787787086.188206:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503585920:0@lo:41: 00000100:00100000:1.0:1787787086.188277:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787086.188397:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503585920 00000100:00100000:0.0:1787787086.188405:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503585920 00000100:00100000:0.0:1787787086.188456:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787086.188466:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503585920:12345-0@lo:41: 00000004:00000024:0.0:1787787086.188512:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787787086.188771:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503585920:12345-0@lo:41: Request processed in 304us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787086.188779:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787086.199759:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503585920:0@lo:41: 00010000:00010000:1.0:1787787086.640535:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787086.699448:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787086.699479:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503586048:0@lo:41: 00000100:00100000:3.0:1787787086.699556:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787086.700068:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586048 00000100:00100000:2.0:1787787086.700076:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586048 00000100:00100000:2.0:1787787086.700127:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787086.700201:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503586048:12345-0@lo:41: 00000004:00000024:2.0:1787787086.700235:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1787787086.700374:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503586048:12345-0@lo:41: Request processed in 239us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787086.700394:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787086.703646:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503586048:0@lo:41: 00010000:00010000:1.0:1787787087.658065:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787088.683266:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787089.706331:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787090.281338:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503586432:0@lo:400: 00000100:00100000:1.0:1787787090.281404:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787090.281450:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503586944:0@lo:400: 00000100:00100000:1.0:1787787090.281499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787090.281528:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787090.281534:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503586560:0@lo:400: 00000100:00100000:1.0:1787787090.281556:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787090.281589:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586432 00000100:00100000:1.0:1787787090.281596:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586432 00000100:00100000:1.0:1787787090.281654:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787090.281663:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503586432:12345-0@lo:400: 00000100:00100000:1.0:1787787090.281891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503586432:12345-0@lo:400: Request processed in 228us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787090.281899:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787090.281923:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586944 00000100:00100000:1.0:1787787090.281927:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586944 00000100:00100000:1.0:1787787090.281966:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586560 00000100:00080000:3.0:1787787090.281973:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787090.282123:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503586304:0@lo:400: 00000100:00100000:0.0:1787787090.282173:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787090.282197:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503586816:0@lo:400: 00000100:00100000:2.0:1787787090.282225:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503586176:0@lo:400: 00000100:00100000:0.0:1787787090.282226:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787090.282256:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586304 00000100:00100000:0.0:1787787090.282261:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586304 00000100:00100000:2.0:1787787090.282270:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787090.282283:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586816 00000100:00100000:0.0:1787787090.282287:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586816 00000100:00100000:2.0:1787787090.282305:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503586688:0@lo:400: 00000100:00080000:3.0:1787787090.282320:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787090.282332:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787090.282338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787090.282346:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503586944:12345-0@lo:400: 00000100:00100000:2.0:1787787090.282374:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586688 00000100:00100000:2.0:1787787090.282379:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586688 00000100:00100000:0.0:1787787090.282392:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503586944:12345-0@lo:400: Request processed in 50us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787090.282400:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787090.282405:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787090.282416:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503586688:12345-0@lo:400: 00000100:00100000:0.0:1787787090.282422:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787090.282432:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503586304:12345-0@lo:400: 00000100:00100000:2.0:1787787090.282464:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503586688:12345-0@lo:400: Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787090.282472:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787090.282493:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503586304:12345-0@lo:400: Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787090.282496:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787787090.282507:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787090.282510:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503586816:12345-0@lo:400: 00010000:00080000:0.0:1787787090.282547:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc306940 x1874630503586304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787090.282549:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503586816:12345-0@lo:400: Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787090.282565:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787787090.282576:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503586304:0@lo:400: 00010000:00080000:0.0:1787787090.282595:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc305a40 x1874630503586816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787090.282603:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503586688:0@lo:400: 00000100:00100000:0.0:1787787090.282628:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503586816:0@lo:400: 00000100:00100000:1.0:1787787090.282767:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586560 00000100:00100000:1.0:1787787090.282797:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787090.282813:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503586560:12345-0@lo:400: 00000100:00100000:1.0:1787787090.282846:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503586560:12345-0@lo:400: Request processed in 35us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787090.282852:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787090.282873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503586176 00000100:00100000:1.0:1787787090.282876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503586176 00000100:00100000:1.0:1787787090.282908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787090.282915:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:3653:x1874630503586176:12345-0@lo:400: 00000100:00100000:1.0:1787787090.282950:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:3653:x1874630503586176:12345-0@lo:400: Request processed in 35us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787090.282956:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787090.283121:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503586176:0@lo:400: 00010000:00080000:1.0:1787787090.283165:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc307480 x1874630503586560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787090.283175:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503586560:0@lo:400: 00000100:00100000:1.0:1787787090.283186:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503586432:0@lo:400: 00010000:00080000:1.0:1787787090.283195:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3070c0 x1874630503586944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787090.283203:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503586944:0@lo:400: 00000001:02000400:2.0:1787787090.365190:0:8808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787787090.729334:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787091.103416:0:8860:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787091.103645:0:8860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787787091.306798:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503587072:0@lo:41: 00000100:00100000:0.0:1787787091.306866:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787091.306932:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587072 00000100:00100000:3.0:1787787091.306941:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587072 00000100:00100000:3.0:1787787091.307018:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787787091.307029:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503587072:12345-0@lo:41: 00000004:00000024:3.0:1787787091.307063:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787787091.307114:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503587072:12345-0@lo:41: Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787091.307122:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787091.307235:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503587072:0@lo:41: 00010000:00010000:3.0:1787787091.757319:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787091.818645:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503587200:0@lo:41: 00000100:00100000:1.0:1787787091.818714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787091.819051:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587200 00000100:00100000:3.0:1787787091.819061:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587200 00000100:00100000:3.0:1787787091.819944:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787787091.820047:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503587200:12345-0@lo:41: 00000004:00000024:3.0:1787787091.820083:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1787787091.820206:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503587200:12345-0@lo:41: Request processed in 252us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787091.820213:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787091.820437:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503587200:0@lo:41: 00010000:00010000:0.0:1787787092.777971:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787787093.505051:0:8962:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787093.505350:0:8962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787093.804572:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787787094.261548:0:9010:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787094.261559:0:9010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 10000000:01000000:1.0:1787787094.378423:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787787094.378591:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870d2373000 from 30 10000000:01000000:1.0:1787787094.378597:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787094.378645:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.378657:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.378668:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.378691:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587328:0@lo:101: 00000100:00100000:1.0:1787787094.378757:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.378907:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787094.378948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587328 00000100:00100000:3.0:1787787094.378956:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587328 00000100:00100000:3.0:1787787094.379039:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787787094.379049:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:6524:x1874630503587328:12345-0@lo:101: 00010000:00010000:3.0:1787787094.379061:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787094.379073:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8ae1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.379103:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.379113:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.379134:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:3.0:1787787094.379266:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503587328:12345-0@lo:101: Request processed in 152us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.379273:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787094.379362:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587328:0@lo:101: 00010000:00010000:2.0:1787787094.379379:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.379390:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787094.379465:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587456:0@lo:501: 00000100:00100000:2.0:1787787094.379494:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.379522:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.379600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587456 00000100:00100000:1.0:1787787094.379605:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587456 00000100:00100000:1.0:1787787094.379640:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787094.379647:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503587456:12345-0@lo:501: 00000100:00100000:1.0:1787787094.379748:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503587456:12345-0@lo:501: Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.379754:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787094.379780:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587456:0@lo:501: 00000100:00100000:1.0:1787787094.379802:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587584:0@lo:503: 00000100:00100000:1.0:1787787094.379835:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.379846:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.379854:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587584 00000100:00100000:1.0:1787787094.379861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587584 00000100:00100000:1.0:1787787094.379874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787094.379879:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503587584:12345-0@lo:503: 00000100:00100000:1.0:1787787094.379941:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503587584:12345-0@lo:503: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.379947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787094.379977:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587584:0@lo:503: 00000100:00100000:1.0:1787787094.380130:0:9021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9021:1874630503587712:0@lo:502: 00000100:00100000:1.0:1787787094.380172:0:9021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.380188:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587712 00000100:00100000:1.0:1787787094.380191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587712 00000100:00100000:1.0:1787787094.380457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787787094.380466:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9021:x1874630503587712:12345-0@lo:502: 00000100:00100000:1.0:1787787094.380547:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9021:x1874630503587712:12345-0@lo:502: Request processed in 82us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.380553:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787787094.380588:0:9021:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.380602:0:9021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9021:1874630503587712:0@lo:502: 00000100:00100000:1.0:1787787094.380641:0:9021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9021:1874630503587840:0@lo:502: 00000100:00100000:1.0:1787787094.380674:0:9021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.380693:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587840 00000100:00100000:1.0:1787787094.380696:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587840 00000100:00100000:1.0:1787787094.380715:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787787094.380723:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9021:x1874630503587840:12345-0@lo:502: 00000100:00100000:1.0:1787787094.380783:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9021:x1874630503587840:12345-0@lo:502: Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.380798:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787787094.380827:0:9021:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.380838:0:9021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9021:1874630503587840:0@lo:502: 00000040:00080000:1.0:1787787094.380856:0:9021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787787094.380904:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787787094.380929:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787094.380937:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.380947:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787094.380957:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787094.380960:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870d2373000 from 5 10000000:01000000:1.0:1787787094.380962:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787094.380984:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.380991:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.380999:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.381011:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587968:0@lo:101: 00000100:00100000:1.0:1787787094.381038:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.381050:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.381062:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503587968 00000100:00100000:1.0:1787787094.381065:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503587968 00000100:00100000:1.0:1787787094.381087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787787094.381105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503587968:12345-0@lo:101: 00010000:00010000:1.0:1787787094.381111:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787094.381122:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8aef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.381160:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.381169:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.381177:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5800, rc 0) 00000100:00100000:1.0:1787787094.381209:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503587968:12345-0@lo:101: Request processed in 116us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.381216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787787094.381244:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503587968:0@lo:101: 00010000:00010000:1.0:1787787094.381254:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.381261:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.381294:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588096:0@lo:256: 00000100:00100000:1.0:1787787094.381318:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.381710:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787094.381810:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588096 00000100:00100000:3.0:1787787094.381814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588096 00000100:00100000:3.0:1787787094.381845:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787787094.381852:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503588096:12345-0@lo:256: 20000000:01000000:3.0:1787787094.381865:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787787094.381879:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787787094.381882:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787787094.381966:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503588096:12345-0@lo:256: Request processed in 115us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.381973:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787787094.382005:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588096:0@lo:256: 10000000:01000000:3.0:1787787094.382049:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787094.382054:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382062:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787094.382069:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787787094.382070:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787787094.382072:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787787094.382087:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382113:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382120:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787094.382132:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588224:0@lo:101: 00000100:00100000:3.0:1787787094.382175:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.382188:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787094.382200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588224 00000100:00100000:3.0:1787787094.382203:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588224 00000100:00100000:3.0:1787787094.382220:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787787094.382226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503588224:12345-0@lo:101: 00010000:00010000:3.0:1787787094.382233:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787094.382241:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8afd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382256:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382264:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382271:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6000, rc 0) 00000100:00100000:3.0:1787787094.382298:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503588224:12345-0@lo:101: Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.382303:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787787094.382634:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588224:0@lo:101: 00010000:00010000:3.0:1787787094.382654:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.382661:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787094.382708:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588352:0@lo:501: 00000100:00100000:3.0:1787787094.382733:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.382758:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.382855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588352 00000100:00100000:2.0:1787787094.382861:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588352 00000100:00100000:2.0:1787787094.382894:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787787094.382902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503588352:12345-0@lo:501: 00000100:00100000:2.0:1787787094.383007:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503588352:12345-0@lo:501: Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.383013:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787787094.383078:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588352:0@lo:501: 00000100:00100000:3.0:1787787094.383193:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588480:0@lo:503: 00000100:00100000:3.0:1787787094.383228:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.383249:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.383314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588480 00000100:00100000:1.0:1787787094.383318:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588480 00000100:00100000:1.0:1787787094.383466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787787094.383479:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503588480:12345-0@lo:503: 00000100:00100000:1.0:1787787094.383577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503588480:12345-0@lo:503: Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.383669:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503588480:0@lo:503: 00000100:00100000:1.0:1787787094.383742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787787094.384488:0:9022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9022:1874630503588608:0@lo:502: 00000100:00100000:1.0:1787787094.384602:0:9022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.384688:0:9022:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.384724:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588608 00000100:00100000:2.0:1787787094.384729:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588608 00000100:00100000:2.0:1787787094.384805:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787787094.384813:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:9022:x1874630503588608:12345-0@lo:502: 00000100:00100000:2.0:1787787094.384912:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:9022:x1874630503588608:12345-0@lo:502: Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.384920:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787787094.384983:0:9022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9022:1874630503588608:0@lo:502: 00000020:01000000:1.0:1787787094.385008:0:9022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787094.385015:0:9022:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787787094.385022:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787094.385025:0:9022:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787787094.385031:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787787094.385036:0:9022:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:1.0:1787787094.385060:0:9022:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787787094.385064:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787094.385090:0:9022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9870fc36b370) 00000020:00000080:1.0:1787787094.385125:0:9022:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787787094.385133:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787787094.385226:0:9022:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787787094.385232:0:9022:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787787094.385239:0:9022:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a8b12 00010000:00080000:1.0:1787787094.385269:0:9022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870df55d800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787094.385564:0:9022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787787094.398595:0:9022:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787787094.398616:0:9022:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787787094.398815:0:9022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787094.399030:0:9022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787094.399119:0:9022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787787094.399266:0:9022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787787094.406257:0:9024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787094.406266:0:9024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787787094.413157:0:9022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787787094.413173:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787787094.413213:0:9022:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787787094.413236:0:9022:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a8b19 00000100:00080000:3.0:1787787094.413245:0:9022:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787094.413251:0:9022:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9870df55d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787094.413282:0:9022:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff987101f7b840 x1874630503588736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787094.413307:0:9022:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787787094.413363:0:9022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787094.413373:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787094.413376:0:9022:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787787094.413380:0:9022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787094.413383:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787094.413385:0:9022:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787094.413389:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787094.413391:0:9022:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787787094.413418:0:9022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9022:1874630503589120:0@lo:502: 00000100:00100000:3.0:1787787094.413493:0:9022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.413513:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503588992:0@lo:400: 00000100:00100000:3.0:1787787094.413546:0:9022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787094.413565:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.413642:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503589632:0@lo:400: 00000100:00100000:2.0:1787787094.413665:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503588864:0@lo:400: 00000100:00100000:0.0:1787787094.413674:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.413702:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787094.413706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.413712:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503589248:0@lo:400: 00000100:00100000:2.0:1787787094.413736:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503589504:0@lo:400: 00000100:00100000:0.0:1787787094.413743:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.413779:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.413801:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787094.413807:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503589376:0@lo:400: 00000100:00100000:2.0:1787787094.413831:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.413986:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503588736:0@lo:8: 00000100:00100000:1.0:1787787094.414024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.414063:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589120 00000100:00100000:1.0:1787787094.414069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589120 00000100:00100000:1.0:1787787094.414116:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787787094.414125:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9022:x1874630503589120:12345-0@lo:502: 00000100:00100000:1.0:1787787094.414285:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9022:x1874630503589120:12345-0@lo:502: Request processed in 160us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.414292:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787787094.414333:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589632 00000100:00100000:1.0:1787787094.414337:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589632 00000100:00100000:1.0:1787787094.414366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588864 00000100:00100000:1.0:1787787094.414370:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588864 00000100:00100000:1.0:1787787094.414381:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589248 00000100:00100000:1.0:1787787094.414383:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589248 00000100:00100000:1.0:1787787094.414392:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589504 00000100:00100000:1.0:1787787094.414394:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589504 00000100:00100000:1.0:1787787094.414408:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787094.414414:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503589632:12345-0@lo:400: 00000100:00100000:1.0:1787787094.414459:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503589632:12345-0@lo:400: Request processed in 45us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.414467:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787787094.414483:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870f5940000 x1874630503589632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787094.414484:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787094.414495:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503588864:12345-0@lo:400: 00000100:00100000:0.0:1787787094.414506:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503589632:0@lo:400: 00000100:00100000:1.0:1787787094.414544:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503588864:12345-0@lo:400: Request processed in 51us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.414550:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787094.414562:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787094.414568:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5943c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503589248:12345-0@lo:400: 00000100:00100000:1.0:1787787094.414594:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5943c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503589248:12345-0@lo:400: Request processed in 26us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.414599:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787094.414617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787094.414623:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503589504:12345-0@lo:400: 00000100:00100000:1.0:1787787094.414649:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503589504:12345-0@lo:400: Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.414655:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787787094.414684:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787094.414688:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787787094.414811:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870d4e60f00 x1874630503589248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787094.414821:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503589248:0@lo:400: 00000100:00100000:1.0:1787787094.418011:0:9022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9022:1874630503589120:0@lo:502: 00000020:01000000:1.0:1787787094.418056:0:9022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787094.418065:0:9022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787094.418067:0:9022:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787787094.418072:0:9022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1787787094.418153:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1787787094.418195:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787787094.418207:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.418218:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787094.418228:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787787094.418231:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c3240800 from 30 10000000:01000000:1.0:1787787094.418234:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787094.418263:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.418271:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.418280:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.418306:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503589760:0@lo:101: 00000100:00100000:1.0:1787787094.418367:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.418413:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.418721:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589760 00000100:00100000:2.0:1787787094.418728:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589760 00000100:00100000:2.0:1787787094.418960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787787094.418970:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503589760:12345-0@lo:101: 00010000:00010000:2.0:1787787094.418982:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787094.418996:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8b20 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.419021:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.419032:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.419041:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1390c00, rc 0) 00000100:00100000:2.0:1787787094.419089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503589760:12345-0@lo:101: Request processed in 120us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.419097:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787787094.419256:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588736 00000100:00100000:2.0:1787787094.419262:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588736 00000100:00100000:2.0:1787787094.419292:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787094.419298:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503588736:12345-0@lo:8: 00010000:00080000:2.0:1787787094.419321:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1787787094.419350:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a8b2e 00002000:00100000:2.0:1787787094.419388:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff986fc2a03000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787787094.419392:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1787787094.419397:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787787094.419453:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787787094.419687:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787787094.419712:0:8441:0:(import.c:65:import_set_state_nolock()) ffff986fc2a01800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787094.419758:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503588736:12345-0@lo:8: Request processed in 459us (5733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.419766:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787787094.419973:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870d4e63c00 x1874630503588864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787094.419988:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503588864:0@lo:400: 00010000:00080000:2.0:1787787094.420004:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870d4e63480 x1874630503589504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787094.420014:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503589504:0@lo:400: 00000100:00100000:3.0:1787787094.420186:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503588992 00000100:00100000:3.0:1787787094.420192:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503588992 00000100:00100000:1.0:1787787094.420757:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589376 00000100:00100000:1.0:1787787094.420764:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589376 00000100:00100000:1.0:1787787094.420796:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787094.420806:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f59421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503588992:12345-0@lo:400: 00000100:00100000:1.0:1787787094.420950:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f59421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503588992:12345-0@lo:400: Request processed in 145us (7384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.420958:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787094.420991:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787094.421001:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503589376:12345-0@lo:400: 00000100:00100000:1.0:1787787094.421049:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503589376:12345-0@lo:400: Request processed in 52us (7217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.421057:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787787094.421106:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f7b840 x1874630503588736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787094.421117:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787094.421702:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787787094.421713:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787094.421718:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787787094.421722:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870df55d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787094.421737:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787094.421744:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503588736:0@lo:8: 00000100:00100000:1.0:1787787094.421801:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503589760:0@lo:101: 00010000:00010000:1.0:1787787094.421835:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.421847:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.421981:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503589888:0@lo:501: 00000100:00100000:1.0:1787787094.422021:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.422049:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.422063:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503589888 00000100:00100000:1.0:1787787094.422067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503589888 00000100:00100000:1.0:1787787094.422099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787787094.422108:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503589888:12345-0@lo:501: 00000100:00100000:1.0:1787787094.422464:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503589888:12345-0@lo:501: Request processed in 357us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.422471:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787787094.422587:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503589888:0@lo:501: 00000100:00100000:1.0:1787787094.422614:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590016:0@lo:503: 00000100:00100000:1.0:1787787094.422719:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.422740:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.422751:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590016 00000100:00100000:1.0:1787787094.422755:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590016 00000100:00100000:1.0:1787787094.422778:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787787094.422785:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503590016:12345-0@lo:503: 00000100:00100000:1.0:1787787094.422873:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503590016:12345-0@lo:503: Request processed in 87us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.422954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787787094.423011:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590016:0@lo:503: 00000004:00080000:3.0:1787787094.424339:0:9024:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787787094.424421:0:9024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 238606282054ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787787094.424429:0:9024:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787787094.425388:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503588992:0@lo:400: 00000100:00100000:2.0:1787787094.425463:0:9025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503590144:0@lo:700: 00000100:00100000:2.0:1787787094.425547:0:9025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.425576:0:9025:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787094.425588:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590144 00000100:00100000:3.0:1787787094.425595:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590144 00000100:00100000:3.0:1787787094.425748:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787094.425756:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9025:x1874630503590144:12345-0@lo:700: 00000100:00100000:3.0:1787787094.425791:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8450:1874630503590272:0@lo:700: 00000100:00100000:3.0:1787787094.425821:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.425839:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.426060:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590272 00000100:00100000:1.0:1787787094.426065:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590272 00000100:00100000:1.0:1787787094.426101:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787094.426108:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8450:x1874630503590272:12345-0@lo:700: 00000100:00080000:2.0:1787787094.426248:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787094.427220:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503589376:0@lo:400: 00000004:00080000:3.0:1787787094.427620:0:7458:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787787094.430209:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9026:1874630503590400:0@lo:502: 00000100:00100000:2.0:1787787094.430289:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.430332:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.430341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590400 00000100:00100000:1.0:1787787094.430348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590400 00000100:00100000:1.0:1787787094.430409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787787094.430419:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:9026:x1874630503590400:12345-0@lo:502: 00000100:00100000:1.0:1787787094.430559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:9026:x1874630503590400:12345-0@lo:502: Request processed in 142us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.430567:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787787094.430596:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9026:1874630503590400:0@lo:502: 00000100:00100000:2.0:1787787094.430639:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9026:1874630503590528:0@lo:502: 00000100:00100000:2.0:1787787094.430675:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.430698:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.430742:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590528 00000100:00100000:1.0:1787787094.430746:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590528 00000100:00100000:1.0:1787787094.430806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787787094.430814:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:9026:x1874630503590528:12345-0@lo:502: 00000100:00100000:1.0:1787787094.430891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:9026:x1874630503590528:12345-0@lo:502: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.430898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787787094.430971:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9026:1874630503590528:0@lo:502: 00000040:00080000:3.0:1787787094.430989:0:9026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787787094.431229:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787787094.431260:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787094.431271:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.431283:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787094.431293:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787094.431296:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c3240800 from 5 10000000:01000000:0.0:1787787094.431299:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787094.431326:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.431334:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.431343:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787094.431359:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590656:0@lo:101: 00000100:00100000:0.0:1787787094.431396:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.431434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590656 00000100:00100000:0.0:1787787094.431434:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.431440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590656 00000100:00100000:1.0:1787787094.431478:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787787094.431485:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503590656:12345-0@lo:101: 00010000:00010000:1.0:1787787094.431494:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787094.431506:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8b35 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.431545:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.431556:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.431565:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4000, rc 0) 00000100:00100000:1.0:1787787094.431613:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503590656:12345-0@lo:101: Request processed in 128us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.431619:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787787094.431739:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590656:0@lo:101: 00010000:00010000:0.0:1787787094.431750:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.431758:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787094.431802:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590784:0@lo:256: 00000100:00100000:0.0:1787787094.431839:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.431864:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.431876:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590784 00000100:00100000:1.0:1787787094.431881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590784 00000100:00100000:1.0:1787787094.431909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787787094.431916:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503590784:12345-0@lo:256: 20000000:01000000:1.0:1787787094.431928:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787094.431943:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787094.431947:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787787094.432035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503590784:12345-0@lo:256: Request processed in 119us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.432043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787787094.432046:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590784:0@lo:256: 10000000:01000000:0.0:1787787094.433551:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787094.433564:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.433576:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787094.433585:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787787094.433587:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787787094.433590:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787787094.433615:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.433623:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787094.433633:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787094.433653:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590912:0@lo:101: 00000100:00100000:0.0:1787787094.434447:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.434492:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787094.434542:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503590912 00000100:00100000:3.0:1787787094.434550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503590912 00000100:00100000:3.0:1787787094.434603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787787094.434612:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503590912:12345-0@lo:101: 00010000:00010000:3.0:1787787094.434673:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787094.434689:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8b43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.434711:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.434722:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787094.434730:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6800, rc 0) 00000100:00100000:3.0:1787787094.434776:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503590912:12345-0@lo:101: Request processed in 165us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.434783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787787094.434925:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503590912:0@lo:101: 00010000:00010000:2.0:1787787094.434939:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.434948:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787094.435009:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591040:0@lo:501: 00000100:00100000:2.0:1787787094.435040:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.435056:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.435070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591040 00000100:00100000:2.0:1787787094.435073:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591040 00000100:00100000:2.0:1787787094.435094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787787094.435100:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503591040:12345-0@lo:501: 00000100:00100000:2.0:1787787094.435238:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503591040:12345-0@lo:501: Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.435245:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787787094.435434:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591040:0@lo:501: 00000100:00100000:2.0:1787787094.435466:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591168:0@lo:503: 00000100:00100000:2.0:1787787094.435521:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.435558:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787094.435591:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591168 00000100:00100000:0.0:1787787094.435596:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591168 00000100:00100000:0.0:1787787094.435626:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787787094.435633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503591168:12345-0@lo:503: 00000100:00100000:0.0:1787787094.435729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503591168:12345-0@lo:503: Request processed in 95us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787094.435735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787787094.436930:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591168:0@lo:503: 00000100:00100000:0.0:1787787094.437577:0:9027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9027:1874630503591296:0@lo:502: 00000100:00100000:0.0:1787787094.437633:0:9027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.437761:0:9027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.437833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591296 00000100:00100000:2.0:1787787094.437839:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591296 00000100:00100000:2.0:1787787094.437895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787787094.437905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:9027:x1874630503591296:12345-0@lo:502: 00000100:00100000:2.0:1787787094.438022:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:9027:x1874630503591296:12345-0@lo:502: Request processed in 118us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.438030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787787094.438120:0:9027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9027:1874630503591296:0@lo:502: 00000020:01000000:1.0:1787787094.438182:0:9027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787094.438190:0:9027:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787787094.438197:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787094.438199:0:9027:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787787094.438205:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787787094.438209:0:9027:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:1.0:1787787094.438237:0:9027:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787787094.438240:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787094.438256:0:9027:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9870fc368000) 00000020:00000080:1.0:1787787094.438277:0:9027:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1787787094.438283:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787787094.438363:0:9027:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787787094.438368:0:9027:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787787094.438375:0:9027:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a8b58 00010000:00080000:1.0:1787787094.438413:0:9027:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870fc38e000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787094.438653:0:9027:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:3.0:1787787094.439099:0:6534:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1787787094.446786:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8450:x1874630503590272:12345-0@lo:700: Request processed in 20669us (20953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.446806:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787787094.447121:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f7a580 x1874630503590272/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787094.447152:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8450:1874630503590272:0@lo:700: 40000000:02000000:0.0:1787787094.447165:0:8450:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1787787094.458815:0:9027:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787787094.458838:0:9027:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787787094.459034:0:9027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787094.459251:0:9027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787094.459337:0:9027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787787094.459433:0:9027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787787094.460778:0:9028:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787094.460787:0:9028:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:3.0:1787787094.460980:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787787094.461479:0:9027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787787094.461490:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787787094.461526:0:9027:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787787094.461559:0:9027:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a8b5f 00000100:00080000:2.0:1787787094.461570:0:9027:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787094.461576:0:9027:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9870fc38e000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787094.461611:0:9027:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3b0f00 x1874630503591424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787094.461667:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503591424:0@lo:8: 00000100:00100000:3.0:1787787094.461734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.461823:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591424 00000100:00100000:1.0:1787787094.461829:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591424 00000100:00100000:1.0:1787787094.461860:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787094.461867:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503591424:12345-0@lo:8: 00010000:00080000:1.0:1787787094.461889:0:8444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1787787094.461913:0:8444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a8b66 00002000:00100000:1.0:1787787094.461925:0:8444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9870ff9bf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787787094.461929:0:8444:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787787094.461932:0:8444:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787787094.461992:0:8444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787787094.462011:0:8444:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787787094.462060:0:9027:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787787094.462129:0:9027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787094.462133:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787094.462135:0:9027:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787787094.462159:0:9027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787094.462164:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787094.462166:0:9027:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787787094.462169:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787787094.462171:0:9027:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787787094.462191:0:9027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9027:1874630503591552:0@lo:502: 00000100:00100000:2.0:1787787094.462232:0:9027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787094.462249:0:9027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.462823:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503591424:12345-0@lo:8: Request processed in 953us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.462843:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787094.462871:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591552 00000100:00100000:1.0:1787787094.462875:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591552 00000100:00100000:1.0:1787787094.462907:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787787094.462913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+20:9027:x1874630503591552:12345-0@lo:502: 00000100:00100000:1.0:1787787094.463020:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+20:9027:x1874630503591552:12345-0@lo:502: Request processed in 107us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.463027:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787787094.463087:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9025:x1874630503590144:12345-0@lo:700: Request processed in 37331us (37541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.463096:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787787094.463205:0:9025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0000 x1874630503590144/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787094.463220:0:9025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503590144:0@lo:700: 00000100:00100000:2.0:1787787094.463294:0:9027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9027:1874630503591552:0@lo:502: 00000020:01000000:2.0:1787787094.463312:0:9027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787094.463316:0:9027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787094.463318:0:9027:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787787094.463321:0:9027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787787094.463519:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787787094.463548:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787787094.463556:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.463566:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787094.463576:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787787094.463578:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9870d15599b8 from 1 10000000:01000000:1.0:1787787094.463580:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787787094.463614:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.463621:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.463631:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.463652:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591680:0@lo:101: 00000100:00100000:1.0:1787787094.463684:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.463715:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2e36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.463761:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591680 00000100:00100000:2.0:1787787094.463766:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591680 00000100:00100000:2.0:1787787094.463799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787787094.463806:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503591680:12345-0@lo:101: 00010000:00010000:2.0:1787787094.463815:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787094.463827:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8b6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.463848:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.463859:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787094.463868:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391800, rc 0) 00000100:00100000:2.0:1787787094.463897:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503591680:12345-0@lo:101: Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.463903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787787094.463965:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591680:0@lo:101: 00010000:00010000:1.0:1787787094.463977:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.463986:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787094.464050:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591808:0@lo:501: 00000100:00100000:1.0:1787787094.464071:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.464086:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2e36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.464095:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591808 00000100:00100000:1.0:1787787094.464099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591808 00000100:00100000:1.0:1787787094.464115:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787787094.464119:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503591808:12345-0@lo:501: 00000100:00100000:1.0:1787787094.464202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503591808:12345-0@lo:501: Request processed in 82us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787094.464209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787787094.464237:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503591808:0@lo:501: 10000000:01000000:1.0:1787787094.464259:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787787094.464264:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787094.464271:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787787094.464658:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0f00 x1874630503591424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787094.464668:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787094.464674:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787787094.464687:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787787094.464692:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787787094.464696:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc38e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787787094.464754:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787787094.464761:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503591424:0@lo:8: 00000004:00080000:2.0:1787787094.464812:0:9028:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787787094.464869:0:9028:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 238646729580ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787787094.464874:0:9028:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787787094.471816:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787787094.472340:0:9025:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787787094.472369:0:9025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503592064:0@lo:7: 00000100:00100000:3.0:1787787094.472436:0:9025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.472474:0:9025:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787094.473444:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503591936:0@lo:13: 00000100:00100000:0.0:1787787094.473493:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.473561:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503591936 00000100:00100000:0.0:1787787094.473567:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503591936 00000100:00100000:0.0:1787787094.473610:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787094.473618:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503591936:12345-0@lo:13: 00002000:00000024:0.0:1787787094.473645:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787787094.473687:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503591936:12345-0@lo:13: Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787094.473694:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787787094.473735:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f7b0c0 x1874630503591936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787094.473749:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503591936:0@lo:13: 00000100:00100000:3.0:1787787094.473900:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592064 00000100:00100000:3.0:1787787094.473905:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592064 00000100:00100000:3.0:1787787094.473942:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787094.473949:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9025:x1874630503592064:12345-0@lo:7: 00000004:00080000:1.0:1787787094.477248:0:9029:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787787094.477276:0:9029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503592320:0@lo:7: 00000100:00100000:1.0:1787787094.477336:0:9029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.477370:0:8443:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787094.477376:0:8443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787787094.477389:0:9029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2e36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787094.477440:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787094.477453:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503592192:0@lo:13: 00000100:00100000:0.0:1787787094.477499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.477628:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592192 00000100:00100000:1.0:1787787094.477636:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592192 00000100:00100000:2.0:1787787094.477664:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592320 00000100:00100000:2.0:1787787094.477670:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592320 00000100:00100000:1.0:1787787094.477694:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787094.477704:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5942580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874630503592192:12345-0@lo:13: 00002000:00000024:1.0:1787787094.477722:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787787094.477771:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5942580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874630503592192:12345-0@lo:13: Request processed in 69us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.477777:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787787094.477827:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc10b1a40 x1874630503592192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787094.477842:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787094.477854:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503592192:0@lo:13: 00000100:00100000:0.0:1787787094.477915:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787094.477922:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9029:x1874630503592320:12345-0@lo:7: 00002000:00080000:3.0:1787787094.478665:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787787094.478671:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787787094.478729:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9025:x1874630503592064:12345-0@lo:7: Request processed in 4779us (6292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.478736:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787787094.479181:0:9025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f78780 x1874630503592064/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787094.479194:0:9025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503592064:0@lo:7: 00000004:00080000:2.0:1787787094.479204:0:9025:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787787094.479234:0:9025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503592448:0@lo:5: 00000100:00100000:2.0:1787787094.479267:0:9025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.479326:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592448 00000100:00100000:1.0:1787787094.479332:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592448 00000100:00100000:1.0:1787787094.479403:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787094.479422:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9025:x1874630503592448:12345-0@lo:5: 00002000:00080000:1.0:1787787094.479442:0:8443:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787787094.479470:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9025:x1874630503592448:12345-0@lo:5: Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787094.479477:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787094.479688:0:9025:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d6c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787787094.479704:0:9025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0b40 x1874630503592448/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787094.479715:0:9025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503592448:0@lo:5: 00000004:00080000:3.0:1787787094.479724:0:9025:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787787094.479748:0:9025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503592576:0@lo:5: 00000100:00100000:3.0:1787787094.479773:0:9025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.479804:0:9025:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787094.479837:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592576 00000100:00100000:1.0:1787787094.479841:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592576 00000100:00100000:1.0:1787787094.479902:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787094.479909:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9025:x1874630503592576:12345-0@lo:5: 00002000:00080000:1.0:1787787094.479929:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787787094.481826:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9025:x1874630503592576:12345-0@lo:5: Request processed in 1912us (2047us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787787094.481836:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787787094.481988:0:9025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f79a40 x1874630503592576/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787094.482005:0:9025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9025:1874630503592576:0@lo:5: 00000004:00080000:3.0:1787787094.482017:0:9025:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787787094.482050:0:9025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9025:1874630503592704:0@lo:900: 00000100:00100000:3.0:1787787094.482082:0:9025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787094.482113:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592704 00000100:00100000:3.0:1787787094.482118:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592704 00000100:00100000:3.0:1787787094.482167:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787094.482176:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9025:x1874630503592704:12345-0@lo:900: 00000100:00100000:3.0:1787787094.482214:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9025:x1874630503592704:12345-0@lo:900: Request processed in 39us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787094.482220:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787094.482238:0:9025:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb39c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787787094.482251:0:9025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f7a1c0 x1874630503592704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787094.482260:0:9025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9025:1874630503592704:0@lo:900: 00002000:00080000:0.0:1787787094.484922:0:9030:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787787094.484931:0:9030:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787787094.485122:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9029:x1874630503592320:12345-0@lo:7: Request processed in 7195us (7781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787094.485133:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787094.485240:0:9029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc10b0780 x1874630503592320/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787094.485254:0:9029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503592320:0@lo:7: 00000004:00080000:1.0:1787787094.485267:0:9029:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787787094.485301:0:9029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503592832:0@lo:5: 00000100:00100000:1.0:1787787094.485335:0:9029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.485404:0:9029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2e36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787094.485436:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592832 00000100:00100000:3.0:1787787094.485442:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592832 00000100:00100000:3.0:1787787094.485513:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787094.485523:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9029:x1874630503592832:12345-0@lo:5: 00002000:00080000:3.0:1787787094.485554:0:8444:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787787094.485558:0:8444:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787787094.488979:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1787787094.488998:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787787094.489005:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787787094.489201:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9029:x1874630503592832:12345-0@lo:5: Request processed in 3675us (3860us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787787094.489213:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787787094.489334:0:9029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc10b0780 x1874630503592832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787094.489346:0:9029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787787094.489353:0:9029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503592832:0@lo:5: 00000004:00080000:1.0:1787787094.489368:0:9029:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787787094.489412:0:9029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503592960:0@lo:700: 00000100:00100000:1.0:1787787094.489446:0:9029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787094.489478:0:9029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2e36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787094.490460:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503592960 00000100:00100000:0.0:1787787094.490469:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503592960 00000100:00100000:0.0:1787787094.490525:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787094.490547:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9029:x1874630503592960:12345-0@lo:700: 00010000:00080000:1.0:1787787094.500956:0:9029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc10b0780 x1874630503592960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787094.500977:0:9029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503592960:0@lo:700: 00000100:00100000:2.0:1787787094.501023:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9029:x1874630503592960:12345-0@lo:700: Request processed in 10414us (11513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787094.501041:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:0.0:1787787094.505214:0:9029:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1787787094.511850:0:9029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f59412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503593088:0@lo:5: 00000100:00100000:0.0:1787787094.511992:0:9029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787094.512174:0:9029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787094.512478:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593088 00000100:00100000:2.0:1787787094.512487:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593088 00000100:00100000:2.0:1787787094.512597:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787094.512607:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9029:x1874630503593088:12345-0@lo:5: 00002000:00080000:2.0:1787787094.521515:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787787094.521549:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787787094.526659:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9029:x1874630503593088:12345-0@lo:5: Request processed in 14046us (14660us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787787094.526672:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787787094.526741:0:9029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870f59412c0 x1874630503593088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787094.526760:0:9029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f59412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9029:1874630503593088:0@lo:5: 00000004:00080000:0.0:1787787094.526775:0:9029:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1787787094.826479:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787095.856298:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787096.426604:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787096.426639:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503593216:0@lo:41: 00000100:00100000:1.0:1787787096.426731:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787096.426828:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593216 00000100:00100000:1.0:1787787096.426838:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593216 00000100:00100000:1.0:1787787096.426895:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787787096.426905:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503593216:12345-0@lo:41: 00000004:00000024:1.0:1787787096.426948:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787787096.427002:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503593216:12345-0@lo:41: Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787096.427009:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787787096.427067:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503593216:0@lo:41: 00010000:00010000:2.0:1787787096.873255:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787096.939060:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503593344:0@lo:41: 00000100:00100000:3.0:1787787096.939198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787096.939244:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593344 00000100:00100000:0.0:1787787096.939262:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593344 00000100:00100000:0.0:1787787096.939326:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787096.939337:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503593344:12345-0@lo:41: 00000004:00000024:0.0:1787787096.939385:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787787096.939457:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503593344:12345-0@lo:41: Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787096.939465:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787096.939567:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503593344:0@lo:41: 00010000:00010000:1.0:1787787097.897448:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787098.922825:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787099.497378:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503593472:0@lo:13: 00000100:00100000:2.0:1787787099.497446:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503593600:0@lo:400: 00000100:00100000:1.0:1787787099.497606:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503593728:0@lo:400: 00000100:00100000:3.0:1787787099.498072:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503593856:0@lo:400: 00000100:00100000:0.0:1787787099.503667:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.503797:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503593984:0@lo:400: 00000100:00100000:0.0:1787787099.503840:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.503880:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503594496:0@lo:400: 00000100:00100000:0.0:1787787099.503911:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.503979:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593472 00000100:00100000:0.0:1787787099.503988:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593472 00000100:00100000:0.0:1787787099.504059:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787099.504071:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503593472:12345-0@lo:13: 00002000:00000024:0.0:1787787099.504116:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787099.504190:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503593472:12345-0@lo:13: Request processed in 122us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787099.504198:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787099.504227:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593984 00000100:00100000:0.0:1787787099.504231:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593984 00000100:00100000:0.0:1787787099.504264:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787099.504272:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f59403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503593984:12345-0@lo:400: 00000100:00100000:0.0:1787787099.504308:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f59403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503593984:12345-0@lo:400: Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787099.504337:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787099.504360:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594496 00000100:00100000:0.0:1787787099.504364:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594496 00000100:00100000:0.0:1787787099.504416:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787099.504425:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503594496:12345-0@lo:400: 00000100:00100000:0.0:1787787099.504470:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503594496:12345-0@lo:400: Request processed in 47us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787099.504477:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787787099.504495:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787099.504536:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b1e00 x1874630503593984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787099.504553:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503593984:0@lo:400: 00010000:00080000:0.0:1787787099.504565:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b1680 x1874630503594496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787099.504573:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787787099.504590:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503594496:0@lo:400: 00010000:00080000:0.0:1787787099.504601:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870f5942d00 x1874630503593472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787099.504618:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503593472:0@lo:13: 00000100:00100000:0.0:1787787099.513258:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.513337:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503594240:0@lo:400: 00000100:00100000:0.0:1787787099.513379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787099.513820:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787099.513866:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503594112:0@lo:400: 00000100:00100000:3.0:1787787099.513905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.513925:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503594752:0@lo:13: 00000100:00100000:3.0:1787787099.513936:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503594624:0@lo:400: 00000100:00100000:0.0:1787787099.513962:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.514026:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594752 00000100:00100000:0.0:1787787099.514036:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594752 00000100:00100000:2.0:1787787099.514048:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593728 00000100:00100000:2.0:1787787099.514055:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593728 00000100:00100000:2.0:1787787099.514105:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594240 00000100:00100000:0.0:1787787099.514106:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787099.514109:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594240 00000100:00100000:0.0:1787787099.514122:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503594752:12345-0@lo:13: 00000100:00100000:2.0:1787787099.514167:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00002000:00000024:0.0:1787787099.514177:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787099.514188:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5942d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503593728:12345-0@lo:400: 00000100:00100000:2.0:1787787099.514245:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5942d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503593728:12345-0@lo:400: Request processed in 60us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787099.514253:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787099.514272:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787787099.514278:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f59430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503594240:12345-0@lo:400: 00000100:00100000:2.0:1787787099.514305:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f59430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503594240:12345-0@lo:400: Request processed in 29us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787099.514310:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787787099.514339:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787099.514470:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787099.514516:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593600 00000100:00100000:3.0:1787787099.514522:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593600 00000100:00100000:3.0:1787787099.514559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787787099.514566:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:3653:x1874630503593600:12345-0@lo:400: 00000100:00100000:3.0:1787787099.514605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:3653:x1874630503593600:12345-0@lo:400: Request processed in 40us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787099.514612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787787099.514645:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594112 00000100:00100000:3.0:1787787099.514649:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594112 00000100:00100000:3.0:1787787099.514681:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787099.514688:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503594112:12345-0@lo:400: 00000100:00100000:2.0:1787787099.514825:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594624 00000100:00100000:2.0:1787787099.514830:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594624 00000100:00100000:2.0:1787787099.514862:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787099.514872:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503594624:12345-0@lo:400: 00010000:00080000:1.0:1787787099.515132:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b3480 x1874630503593728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787099.515203:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503593728:0@lo:400: 00010000:00080000:1.0:1787787099.515238:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0b40 x1874630503594240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787099.515249:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503594240:0@lo:400: 00000100:00100000:3.0:1787787099.515417:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503594112:12345-0@lo:400: Request processed in 728us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787099.515425:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787099.517562:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503593600:0@lo:400: 00000100:00100000:3.0:1787787099.517616:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503594112:0@lo:400: 00000100:00100000:2.0:1787787099.523036:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503594624:12345-0@lo:400: Request processed in 8152us (8551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787099.523055:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787099.526019:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503594752:12345-0@lo:13: Request processed in 11886us (12041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787099.526039:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787099.526191:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff987101f7ad00 x1874630503594752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787099.526222:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503594752:0@lo:13: 00010000:00080000:3.0:1787787099.533243:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b03c0 x1874630503594624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787099.533270:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503594624:0@lo:400: 00000100:00100000:3.0:1787787099.533346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787099.533492:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503593856 00000100:00100000:0.0:1787787099.533502:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503593856 00000100:00100000:3.0:1787787099.533503:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503594368:0@lo:400: 00000100:00100000:3.0:1787787099.533561:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787099.533624:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594368 00000100:00100000:1.0:1787787099.533630:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594368 00000100:00100000:1.0:1787787099.533713:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787099.533727:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503594368:12345-0@lo:400: 00000100:00080000:3.0:1787787099.533728:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787099.533851:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787099.533861:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503593856:12345-0@lo:400: 00000100:00100000:0.0:1787787099.533917:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503593856:12345-0@lo:400: Request processed in 58us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787099.533925:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787099.534043:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503594368:12345-0@lo:400: Request processed in 319us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787099.534053:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787099.534095:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503593856:0@lo:400: 00010000:00080000:3.0:1787787099.534108:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0f00 x1874630503594368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787099.534117:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503594368:0@lo:400: 00010000:00010000:1.0:1787787099.955877:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787787100.019987:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787787100.969375:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787101.545627:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787101.545665:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503594880:0@lo:41: 00000100:00100000:0.0:1787787101.545764:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787101.545847:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503594880 00000100:00100000:0.0:1787787101.545856:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503594880 00000100:00100000:0.0:1787787101.545916:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787101.545938:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5942940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503594880:12345-0@lo:41: 00000004:00000024:0.0:1787787101.545986:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787787101.546051:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5942940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503594880:12345-0@lo:41: Request processed in 126us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787101.546059:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787101.546114:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503594880:0@lo:41: 00010000:00010000:1.0:1787787101.994873:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787102.061216:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503595008:0@lo:41: 00000100:00100000:1.0:1787787102.061322:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787102.061445:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595008 00000100:00100000:1.0:1787787102.061456:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595008 00000100:00100000:1.0:1787787102.061516:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787102.061531:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503595008:12345-0@lo:41: 00000004:00000024:1.0:1787787102.061578:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787787102.061909:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503595008:12345-0@lo:41: Request processed in 376us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787102.061916:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787102.062112:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503595008:0@lo:41: 00010000:00010000:2.0:1787787103.017767:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787104.041569:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787104.618797:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503595264:0@lo:400: 00000100:00100000:2.0:1787787104.618892:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.618956:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503595776:0@lo:400: 00000100:00100000:2.0:1787787104.618980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619015:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787787104.619022:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503595136:0@lo:400: 00000100:00100000:2.0:1787787104.619068:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619089:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503595648:0@lo:400: 00000100:00100000:2.0:1787787104.619114:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619133:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503596160:0@lo:400: 00000100:00100000:2.0:1787787104.619181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619211:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503595392:0@lo:400: 00000100:00100000:2.0:1787787104.619235:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503595904:0@lo:400: 00000100:00100000:2.0:1787787104.619284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619304:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787787104.619309:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503595520:0@lo:400: 00000100:00100000:2.0:1787787104.619343:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619362:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503596032:0@lo:400: 00000100:00100000:2.0:1787787104.619386:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787104.619423:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595264 00000100:00100000:2.0:1787787104.619432:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595264 00000100:00100000:2.0:1787787104.619562:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595776 00000100:00100000:2.0:1787787104.619566:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595776 00000100:00100000:2.0:1787787104.619591:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595904 00000100:00100000:2.0:1787787104.619594:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595904 00000100:00100000:2.0:1787787104.619607:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595520 00000100:00100000:2.0:1787787104.619610:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595520 00000100:00100000:2.0:1787787104.619648:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787104.619658:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503595264:12345-0@lo:400: 00000100:00100000:2.0:1787787104.619725:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503595264:12345-0@lo:400: Request processed in 68us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.619733:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787104.619760:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787104.619766:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503595776:12345-0@lo:400: 00000100:00100000:2.0:1787787104.619796:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503595776:12345-0@lo:400: Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.619801:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787104.619812:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787104.619818:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503595904:12345-0@lo:400: 00000100:00100000:2.0:1787787104.619848:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503595904:12345-0@lo:400: Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.619855:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787104.619866:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787104.619872:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503595520:12345-0@lo:400: 00000100:00100000:2.0:1787787104.619896:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503595520:12345-0@lo:400: Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.619902:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787104.619932:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595648 00000100:00100000:2.0:1787787104.619936:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595648 00000100:00100000:2.0:1787787104.619953:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595392 00000100:00100000:2.0:1787787104.619956:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595392 00000100:00100000:2.0:1787787104.619967:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787104.619973:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503595648:12345-0@lo:400: 00000100:00100000:2.0:1787787104.620005:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503595648:12345-0@lo:400: Request processed in 32us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.620010:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787104.620021:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787104.620027:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503595392:12345-0@lo:400: 00000100:00100000:2.0:1787787104.620053:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503595392:12345-0@lo:400: Request processed in 26us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.620065:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787104.620087:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596160 00000100:00100000:2.0:1787787104.620091:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596160 00000100:00100000:2.0:1787787104.620120:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596032 00000100:00100000:2.0:1787787104.620123:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596032 00000100:00100000:2.0:1787787104.620170:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787104.620177:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503596160:12345-0@lo:400: 00000100:00100000:2.0:1787787104.620211:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503596160:12345-0@lo:400: Request processed in 35us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.620217:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787104.620228:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787104.620233:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503596032:12345-0@lo:400: 00000100:00100000:2.0:1787787104.620257:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503596032:12345-0@lo:400: Request processed in 24us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787104.620263:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787787104.620314:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b12c0 x1874630503595520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.620343:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503595520:0@lo:400: 00010000:00080000:2.0:1787787104.620358:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b1680 x1874630503596032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.620366:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503596032:0@lo:400: 00000100:00100000:2.0:1787787104.620376:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503595392:0@lo:400: 00010000:00080000:2.0:1787787104.620387:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b3480 x1874630503595904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.620394:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503595904:0@lo:400: 00000100:00100000:2.0:1787787104.623920:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503595648:0@lo:400: 00010000:00080000:2.0:1787787104.623965:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b1e00 x1874630503596160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.623977:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787787104.623997:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503596160:0@lo:400: 00010000:00080000:2.0:1787787104.624013:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b2580 x1874630503595264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.624023:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503595264:0@lo:400: 00010000:00080000:2.0:1787787104.624038:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0b40 x1874630503595776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.624048:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503595776:0@lo:400: 00000100:00100000:0.0:1787787104.624693:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503595136 00000100:00100000:0.0:1787787104.624714:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503595136 00000100:00080000:3.0:1787787104.624798:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787104.624806:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787104.624809:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787104.624900:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787104.624919:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503596288:0@lo:13: 00000100:00100000:3.0:1787787104.625002:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787104.625064:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596288 00000100:00100000:3.0:1787787104.625068:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596288 00000100:00100000:3.0:1787787104.625118:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787104.625130:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503596288:12345-0@lo:13: 00002000:00000024:3.0:1787787104.625198:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787104.625250:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503596288:12345-0@lo:13: Request processed in 122us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787104.625258:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787787104.625298:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870d9645680 x1874630503596288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787104.625315:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503596288:0@lo:13: 00000100:00100000:2.0:1787787104.625701:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787104.625714:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503596416:0@lo:13: 00000100:00100000:2.0:1787787104.625750:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787104.625863:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787787104.625870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:3654:x1874630503595136:12345-0@lo:400: 00000100:00100000:0.0:1787787104.625916:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:3654:x1874630503595136:12345-0@lo:400: Request processed in 46us (6847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787104.625923:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787787104.626223:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596416 00000100:00100000:3.0:1787787104.626230:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596416 00000100:00100000:3.0:1787787104.626257:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787104.626263:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503596416:12345-0@lo:13: 00002000:00000024:3.0:1787787104.626276:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787104.626317:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503596416:12345-0@lo:13: Request processed in 54us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787104.626324:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787104.626365:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503595136:0@lo:400: 00010000:00080000:2.0:1787787104.626659:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b0b40 x1874630503596416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787104.626677:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503596416:0@lo:13: 00010000:00010000:2.0:1787787105.065369:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787787105.737058:0:9518:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787787105.737062:0:9518:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787787105.737064:0:9518:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787787105.737190:0:9518:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870f5ba1800 00000020:01000004:1.0:1787787105.737206:0:9518:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787787105.737220:0:9518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787787105.737234:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9870fc3699b8) 00000020:00000080:1.0:1787787105.737251:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787787105.791307:0:9518:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787787105.791507:0:9518:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1787787105.813804:0:9518:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787787105.814004:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787787105.814018:0:9518:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787787105.814029:0:9518:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x11620bc3f30a8b82 00000020:01000004:2.0:1787787105.814036:0:9518:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787787105.814064:0:9518:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787787105.814068:0:9518:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787787105.814074:0:9518:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787787105.814101:0:9518:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787787105.814106:0:9518:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787787105.853022:0:9518:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787105.853058:0:9518:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.131@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787787105.853062:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787105.853064:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787105.853065:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787105.853067:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787105.853068:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787105.853069:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787105.853070:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787105.853072:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787105.853073:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787105.853075:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787105.853076:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787105.853085:0:9518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787787105.853087:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787105.853088:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787105.853089:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787105.853090:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787105.853091:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787105.853092:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787105.853093:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787105.853094:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787105.853094:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787105.853095:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787105.853096:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787105.854480:0:9518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787787105.854509:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503596544:0@lo:253: 00000100:00100000:3.0:1787787105.854652:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787105.854704:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787105.854755:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596544 00000100:00100000:1.0:1787787105.854763:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596544 00000100:00100000:1.0:1787787105.854854:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787787105.854864:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:9518:x1874630503596544:12345-0@lo:253: 20000000:01000000:1.0:1787787105.854898:0:6520:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787787105.854902:0:6520:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787787105.854907:0:6520:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787787105.854911:0:6520:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787787105.855201:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787105.855341:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787787105.855375:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787787105.855396:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787787105.855402:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787787105.855415:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787787105.855429:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787787105.855512:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787787105.856761:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.131@tcp 20000000:01000000:1.0:1787787105.856766:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:1.0:1787787105.856807:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787787105.856820:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787787105.856836:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787787105.856841:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:1.0:1787787105.856853:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787787105.856859:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787787105.856871:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787787105.856887:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787787105.856995:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787787105.857009:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.131@tcp 20000000:01000000:1.0:1787787105.857010:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:1.0:1787787105.857046:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787787105.857053:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787787105.857066:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787787105.857071:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:1.0:1787787105.857083:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787787105.857089:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787787105.857101:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787787105.857118:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1787787105.858891:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1787787105.858917:0:6520:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.131@tcp 20000000:01000000:1.0:1787787105.858920:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.131@tcp (null) (null) (null) 00000040:00080000:1.0:1787787105.858935:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1787787105.858955:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787787105.858972:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1787787105.858978:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.131@tcp (null) (null) 00000040:00080000:1.0:1787787105.858991:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1787787105.858997:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787787105.859009:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1787787105.859024:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1787787105.859037:0:6520:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787787105.859040:0:6520:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787787105.859044:0:6520:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787787105.859087:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787787105.859090:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787787105.862641:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1787787105.862692:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1787787105.862710:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1787787105.862953:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1787787105.862981:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1787787105.862996:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1787787105.863007:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787787105.863010:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787787105.863879:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1787787105.863905:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1787787105.863919:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1787787105.864768:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1787787105.864795:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1787787105.864811:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1787787105.864824:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787787105.864827:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787787105.865260:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1787787105.865288:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1787787105.865300:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787787105.865604:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787787105.865624:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787787105.865639:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1787787105.865648:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787787105.865649:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787787105.865906:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1787787105.866028:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1787787105.866046:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1787787105.866060:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1787787105.866068:0:6520:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787787105.866070:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787787105.866516:0:9528:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1787787105.866543:0:9528:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1787787105.866555:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787787105.866721:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787787105.866747:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787787105.866759:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1787787105.866774:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787787105.866792:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866811:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866819:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866826:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866833:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866840:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866846:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866853:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866861:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866893:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.866918:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 21 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.866933:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503596672:0@lo:104: 00000100:00100000:3.0:1787787105.867011:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787105.867069:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.867078:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 21 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.867087:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503596800:0@lo:104: 00000100:00100000:3.0:1787787105.867108:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787105.867158:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.867167:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 21 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.867184:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503596928:0@lo:104: 00000100:00100000:3.0:1787787105.867205:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787105.867221:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.867229:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 21 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.867237:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597056:0@lo:104: 00000100:00100000:3.0:1787787105.867266:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787105.867283:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.867291:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 21 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.867300:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597184:0@lo:104: 00000100:00100000:3.0:1787787105.867327:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787105.867341:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.867349:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 21 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.867357:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597312:0@lo:104: 00000100:00100000:3.0:1787787105.867552:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787105.867575:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.867584:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 21 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.867592:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597440:0@lo:104: 00000100:00100000:3.0:1787787105.867609:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1e123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787105.867727:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787787105.867743:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.867756:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596672 00000100:00100000:1.0:1787787105.867761:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596672 00000100:00100000:1.0:1787787105.867790:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596800 00000100:00100000:1.0:1787787105.867797:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596800 00000100:00100000:1.0:1787787105.867807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503596928 00000100:00100000:1.0:1787787105.867809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503596928 00000100:00100000:1.0:1787787105.867816:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597056 00000100:00100000:1.0:1787787105.867818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597056 00000100:00100000:1.0:1787787105.867824:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597184 00000100:00100000:1.0:1787787105.867826:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597184 00000100:00100000:1.0:1787787105.867833:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597312 00000100:00100000:1.0:1787787105.867835:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597312 00000100:00100000:1.0:1787787105.867841:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597440 00000100:00100000:1.0:1787787105.867843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597440 00000100:00100000:1.0:1787787105.867853:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787105.867860:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+9:6520:x1874630503596672:12345-0@lo:104: 00010000:00010000:1.0:1787787105.867873:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.867930:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787105.867936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+9:6520:x1874630503596672:12345-0@lo:104: Request processed in 76us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.867943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787105.867958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787105.867962:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+8:6520:x1874630503596800:12345-0@lo:104: 00010000:00010000:1.0:1787787105.867969:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.867997:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787105.868002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+8:6520:x1874630503596800:12345-0@lo:104: Request processed in 40us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.868007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787105.868018:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787105.868030:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+7:6520:x1874630503596928:12345-0@lo:104: 00010000:00010000:1.0:1787787105.868038:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.868065:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787787105.868069:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+7:6520:x1874630503596928:12345-0@lo:104: Request processed in 41us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.868075:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787105.868087:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787105.868092:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+6:6520:x1874630503597056:12345-0@lo:104: 00010000:00010000:1.0:1787787105.868099:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.868122:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787787105.868126:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+6:6520:x1874630503597056:12345-0@lo:104: Request processed in 35us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.868132:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787105.868164:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787105.868169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+5:6520:x1874630503597184:12345-0@lo:104: 00010000:00010000:1.0:1787787105.868177:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.868203:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787787105.868207:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+5:6520:x1874630503597184:12345-0@lo:104: Request processed in 39us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.868213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787105.868224:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787105.868237:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc287a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:6520:x1874630503597312:12345-0@lo:104: 00010000:00010000:1.0:1787787105.868245:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.868272:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787787105.868276:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc287a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:6520:x1874630503597312:12345-0@lo:104: Request processed in 41us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.868281:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787105.868318:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787105.868324:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:6520:x1874630503597440:12345-0@lo:104: 00010000:00010000:1.0:1787787105.868331:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.868354:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787787105.868358:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:6520:x1874630503597440:12345-0@lo:104: Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787105.868645:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503596672:0@lo:104: 00000100:00100000:3.0:1787787105.868654:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503596800:0@lo:104: 00000100:00100000:3.0:1787787105.868660:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503596928:0@lo:104: 00000100:00100000:3.0:1787787105.868666:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597056:0@lo:104: 00000100:00100000:3.0:1787787105.868680:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597184:0@lo:104: 00000100:00100000:3.0:1787787105.868686:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597312:0@lo:104: 00000100:00100000:3.0:1787787105.868692:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6520:1874630503597440:0@lo:104: 00010000:00010000:3.0:1787787105.868718:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.868758:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787787105.868843:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787787105.868851:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.868858:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454fe00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.868863:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.868871:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.868879:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.868885:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.868920:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.868927:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787787105.868966:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503597568:0@lo:103: 00000100:00100000:3.0:1787787105.868999:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.869062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597568 00000100:00100000:0.0:1787787105.869067:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597568 00010000:00010000:0.0:1787787105.869087:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 22 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787105.869108:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787105.869114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+22:3656:x1874630503597568:12345-0@lo:103: 00010000:00010000:0.0:1787787105.869123:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787105.869128:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 22 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.869158:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 22 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.869172:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8b6d expref: 22 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.869186:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787105.869279:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869287:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869297:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787787105.869306:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869323:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.869326:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869333:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.869340:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.869346:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.869372:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869378:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.869390:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869397:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30a8b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b4a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869406:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787787105.869409:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869415:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.869418:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869433:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.869440:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.869445:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.869457:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869463:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.869468:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869475:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4a00/0x11620bc3f30a8b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869484:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787787105.869487:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869492:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.869495:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869500:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.869506:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.869516:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.869541:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869547:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787787105.869793:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+21:3656:x1874630503597568:12345-0@lo:103: Request processed in 678us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.869801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787105.869846:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503597568:0@lo:103: 00000100:00100000:3.0:1787787105.869856:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787105.869862:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503597952:0@lo:103: 00000100:00100000:3.0:1787787105.869885:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787105.869963:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869970:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c7000/0x11620bc3f30a8afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b04 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869980:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787787105.869984:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.869990:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.869993:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870000:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.870006:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.870010:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.870034:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870040:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.870051:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870057:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4400/0x11620bc3f30a8ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8ae8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870065:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787105.870068:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870074:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.870077:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870083:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.870089:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.870094:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.870106:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870112:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.870116:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870122:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8aa9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870131:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787105.870162:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870169:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.870172:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870179:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.870186:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.870191:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.870204:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870210:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.870214:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870220:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8a78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a7f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.870234:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.870236:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.870238:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.870245:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787105.870249:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787105.870257:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503598080:0@lo:103: 00000100:00100000:2.0:1787787105.870282:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.870612:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503597696:0@lo:103: 00000100:00100000:2.0:1787787105.870639:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.870657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597952 00000100:00100000:1.0:1787787105.870662:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597952 00010000:00010000:1.0:1787787105.870686:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 21 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.870708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598080 00000100:00100000:1.0:1787787105.870711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598080 00010000:00010000:1.0:1787787105.870721:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 22 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.870733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787105.870739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+22:3656:x1874630503597952:12345-0@lo:103: 00010000:00010000:1.0:1787787105.870753:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787105.870757:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 22 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.870766:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 22 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.870779:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8afd expref: 22 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.870789:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787105.870823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+21:3656:x1874630503597952:12345-0@lo:103: Request processed in 84us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.870830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787105.870843:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787105.870848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+20:3655:x1874630503598080:12345-0@lo:103: 00010000:00010000:1.0:1787787105.870854:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787105.870858:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 20 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.870867:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 20 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.870876:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8ae1 expref: 20 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.870884:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787105.870904:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+19:3655:x1874630503598080:12345-0@lo:103: Request processed in 56us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.870909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787105.870964:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503597952:0@lo:103: 00000100:00100000:2.0:1787787105.871066:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503598208:0@lo:103: 00000100:00100000:2.0:1787787105.871088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.871192:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787105.871198:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503597824:0@lo:103: 00000100:00100000:2.0:1787787105.871219:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.871493:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597696 00000100:00100000:1.0:1787787105.871498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597696 00010000:00010000:1.0:1787787105.871513:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 19 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.871546:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598208 00000100:00100000:1.0:1787787105.871549:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598208 00010000:00010000:1.0:1787787105.871557:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 20 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.871568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787105.871573:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3641850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+20:3653:x1874630503597696:12345-0@lo:103: 00010000:00010000:1.0:1787787105.871580:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787105.871584:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 20 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.871593:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 20 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.871604:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8b43 expref: 20 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.871613:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787105.871637:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3641850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+19:3653:x1874630503597696:12345-0@lo:103: Request processed in 64us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.871643:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787105.871678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787105.871684:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+18:3653:x1874630503598208:12345-0@lo:103: 00010000:00010000:1.0:1787787105.871691:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787105.871695:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 18 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.871710:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 18 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.871720:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5000/0x11620bc3f30a8aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8aa2 expref: 18 pid: 6520 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.871729:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787105.871750:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+17:3653:x1874630503598208:12345-0@lo:103: Request processed in 67us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.871757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787787105.871894:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503598336:0@lo:103: 00000100:00100000:2.0:1787787105.871915:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.871963:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503597696:0@lo:103: 00000100:00100000:2.0:1787787105.871970:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503598208:0@lo:103: 00000100:00100000:2.0:1787787105.871994:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503598080:0@lo:103: 00000100:00100000:3.0:1787787105.872055:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503597824 00000100:00100000:3.0:1787787105.872059:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503597824 00010000:00010000:3.0:1787787105.872075:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 17 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.872087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598336 00000100:00100000:3.0:1787787105.872090:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598336 00010000:00010000:3.0:1787787105.872098:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787105.872109:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787105.872114:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+18:3653:x1874630503597824:12345-0@lo:103: 00010000:00010000:3.0:1787787105.872120:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787105.872129:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872166:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8b20 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872189:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787105.872219:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+17:3653:x1874630503597824:12345-0@lo:103: Request processed in 105us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787105.872225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787105.872238:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787105.872244:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+16:3653:x1874630503598336:12345-0@lo:103: 00010000:00010000:3.0:1787787105.872251:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787105.872255:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 16 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872264:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 16 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872273:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8a78 expref: 16 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872285:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872293:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872327:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872335:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872342:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872348:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872354:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787105.872358:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872452:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872467:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872476:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787105.872498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+15:3653:x1874630503598336:12345-0@lo:103: Request processed in 254us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787105.872503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787787105.872521:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872586:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787105.872598:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6a00/0x11620bc3f30a8b89 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787105.872611:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787787105.874428:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+14:9518:x1874630503596544:12345-0@lo:253: Request processed in 19558us (19769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787105.874440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787787105.874555:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503597824:0@lo:103: 00000100:00100000:2.0:1787787105.874564:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503598336:0@lo:103: 00000100:00100000:0.0:1787787105.874663:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503596544:0@lo:253: 10000000:01000000:0.0:1787787105.874678:0:9518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787787105.874689:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787105.874691:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787105.874692:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787105.874694:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787787105.874695:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787105.874696:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787105.874698:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787105.874699:0:9518:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787787105.874701:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787105.874702:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787105.874720:0:9518:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870f5ba1800 from lustre-OST0001 10000000:01000000:0.0:1787787105.874744:0:9518:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787787105.874747:0:9518:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787787105.874755:0:9518:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9870d15599b8 local copy 10000000:01000000:0.0:1787787105.874759:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787105.874792:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.874802:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.874812:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787105.874827:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598464:0@lo:101: 00000100:00100000:0.0:1787787105.874860:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.874921:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787105.874997:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598464 00000100:00100000:2.0:1787787105.875003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598464 00000100:00100000:2.0:1787787105.875071:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787787105.875080:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+14:9518:x1874630503598464:12345-0@lo:101: 00010000:00010000:2.0:1787787105.875092:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787105.875105:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8b90 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.875126:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8b90 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.875343:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b90 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.875353:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391c00, rc 0) 00000100:00100000:2.0:1787787105.875450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503598464:12345-0@lo:101: Request processed in 372us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.875457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787787105.875510:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598464:0@lo:101: 00010000:00010000:1.0:1787787105.875523:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.875543:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.875626:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598592:0@lo:501: 00000100:00100000:1.0:1787787105.875653:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.875975:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.876029:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598592 00000100:00100000:0.0:1787787105.876034:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598592 00000100:00100000:0.0:1787787105.876062:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787787105.876069:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503598592:12345-0@lo:501: 00000100:00100000:0.0:1787787105.876156:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503598592:12345-0@lo:501: Request processed in 87us (501us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787105.876175:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787787105.877000:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598592:0@lo:501: 10000000:01000000:1.0:1787787105.877018:0:9518:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787787105.877043:0:9518:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787787105.877048:0:9518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.877058:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.877072:0:9518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.877124:0:9518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787787105.877184:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870f5ba1800 10000000:01000000:1.0:1787787105.877190:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787787105.877195:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787787105.877198:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787105.877202:0:9518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787787105.877205:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787787105.877229:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.877237:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.877247:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.877261:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598720:0@lo:101: 00000100:00100000:1.0:1787787105.877303:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.877448:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.877605:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598720 00000100:00100000:0.0:1787787105.877611:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598720 00000100:00100000:0.0:1787787105.877651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787787105.877660:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503598720:12345-0@lo:101: 00010000:00010000:0.0:1787787105.877672:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787105.877684:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8b9e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.877704:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.877713:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.877720:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14200, rc 0) 00000100:00100000:0.0:1787787105.877761:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503598720:12345-0@lo:101: Request processed in 103us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.877768:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787787105.877852:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598720:0@lo:101: 00010000:00010000:1.0:1787787105.877864:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.877873:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787105.877942:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598848:0@lo:501: 00000100:00100000:1.0:1787787105.877964:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.877986:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787105.878023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598848 00000100:00100000:3.0:1787787105.878027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598848 00000100:00100000:3.0:1787787105.878054:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787787105.878061:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503598848:12345-0@lo:501: 00000100:00100000:3.0:1787787105.878176:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503598848:12345-0@lo:501: Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787105.878183:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787787105.878277:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598848:0@lo:501: 00000100:00100000:1.0:1787787105.878299:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598976:0@lo:503: 00000100:00100000:1.0:1787787105.878348:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.878450:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0480 going to sleep for 11 seconds 00010000:00010000:2.0:1787787105.878513:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787105.878520:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.878596:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.878600:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.878610:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.878617:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.878623:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.878641:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.878648:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.878673:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.878691:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15c00/0x11620bc3f30a8b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x11620bc3f30a8b97 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.878702:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.878704:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.878706:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787105.878713:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787105.878722:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503599104:0@lo:103: 00000100:00100000:2.0:1787787105.878748:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.878778:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599104 00000100:00100000:2.0:1787787105.878781:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599104 00000100:00100000:2.0:1787787105.878807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787105.878813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+16:3656:x1874630503599104:12345-0@lo:103: 00010000:00010000:2.0:1787787105.878821:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787105.878831:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8b90 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.878841:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787105.878863:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+15:3656:x1874630503599104:12345-0@lo:103: Request processed in 50us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.878869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787105.878887:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503599104:0@lo:103: 00000100:00100000:3.0:1787787105.878979:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503598976 00000100:00100000:3.0:1787787105.878983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503598976 00000100:00100000:3.0:1787787105.879040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787787105.879046:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503598976:12345-0@lo:503: 00000100:00100000:3.0:1787787105.879126:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503598976:12345-0@lo:503: Request processed in 79us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787105.879132:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787787105.879370:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503598976:0@lo:503: 00000040:00080000:1.0:1787787105.879702:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787105.879766:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599232:0@lo:502: 00000100:00100000:1.0:1787787105.879802:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.879987:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.880132:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599232 00000100:00100000:0.0:1787787105.880160:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599232 00000100:00100000:0.0:1787787105.880185:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787787105.880193:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503599232:12345-0@lo:502: 00000100:00100000:0.0:1787787105.880269:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503599232:12345-0@lo:502: Request processed in 76us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.880276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787787105.880500:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599232:0@lo:502: 00000040:00080000:1.0:1787787105.880766:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787787105.880794:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787787105.880807:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787787105.880819:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787787105.880831:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787787105.880842:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787787105.880863:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599360:0@lo:502: 00000100:00100000:1.0:1787787105.880902:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.881011:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787105.881058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599360 00000100:00100000:2.0:1787787105.881063:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599360 00000100:00100000:0.0:1787787105.881236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787787105.881245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503599360:12345-0@lo:502: 00000100:00100000:0.0:1787787105.881330:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503599360:12345-0@lo:502: Request processed in 86us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.881337:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787787105.881512:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599360:0@lo:502: 00000040:00080000:1.0:1787787105.881559:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787787105.881572:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1787787105.881986:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787105.881994:0:9529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787787105.882002:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787105.882004:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787787105.882010:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787105.882023:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9870fc36cd28) 00000020:00000080:1.0:1787787105.882045:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787787105.882052:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787787105.882115:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870f5ba1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787787105.882124:0:9529:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787787105.882130:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x11620bc3f30a8bb3 00010000:00010000:1.0:1787787105.887015:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1787787105.887476:0:9529:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787787105.890340:0:9529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787787105.890791:0:9529:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787787105.895997:0:9529:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787787105.896206:0:9529:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787787105.901191:0:9529:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787787105.903597:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787787105.903613:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787105.903620:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787105.903622:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787787105.903626:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787105.903630:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787105.903637:0:9529:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787105.903640:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787105.903642:0:9529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787787105.903667:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787105.903670:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787105.903671:0:9529:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787787105.903674:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787787105.903844:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787787105.903873:0:9518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787787105.903896:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.903909:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787105.903918:0:9518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f5ba1800 from 1 10000000:01000000:0.0:1787787105.903920:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787105.903955:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.903963:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.903974:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787105.903997:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599488:0@lo:101: 00000100:00100000:0.0:1787787105.904067:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.904107:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.904128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599488 00000100:00100000:0.0:1787787105.904162:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599488 00000100:00100000:0.0:1787787105.904207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787787105.904215:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+15:9518:x1874630503599488:12345-0@lo:101: 00010000:00010000:0.0:1787787105.904227:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787105.904239:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8bba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.904274:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.904285:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.904294:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14400, rc 0) 00000100:00100000:0.0:1787787105.904343:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599488:12345-0@lo:101: Request processed in 129us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.904349:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787787105.904408:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599488:0@lo:101: 00010000:00010000:0.0:1787787105.904423:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.904431:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787105.904506:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599616:0@lo:501: 00000100:00100000:0.0:1787787105.904664:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.905647:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787105.907278:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599616 00000100:00100000:1.0:1787787105.907289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599616 00000100:00100000:1.0:1787787105.907401:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787787105.907411:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599616:12345-0@lo:501: 00000100:00100000:1.0:1787787105.907949:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599616:12345-0@lo:501: Request processed in 538us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.907958:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787787105.911507:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599616:0@lo:501: 00000100:00100000:2.0:1787787105.911686:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599744:0@lo:503: 00000100:00100000:2.0:1787787105.911758:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.911828:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787105.911888:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599744 00000100:00100000:1.0:1787787105.911894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599744 00000100:00100000:1.0:1787787105.911944:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787787105.911953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599744:12345-0@lo:503: 00000100:00100000:1.0:1787787105.912074:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599744:12345-0@lo:503: Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.912081:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787787105.912247:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599744:0@lo:503: 00000040:00080000:3.0:1787787105.912515:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787105.912703:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599872:0@lo:502: 00000100:00100000:3.0:1787787105.912744:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787105.912764:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787105.912833:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503599872 00000100:00100000:2.0:1787787105.912838:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503599872 00000100:00100000:2.0:1787787105.912863:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787787105.912870:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599872:12345-0@lo:502: 00000100:00100000:2.0:1787787105.912957:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503599872:12345-0@lo:502: Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.912964:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787787105.913072:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503599872:0@lo:502: 00000040:00080000:3.0:1787787105.913333:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787787105.913682:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787787105.913709:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600000:0@lo:502: 00000100:00100000:3.0:1787787105.913752:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787105.913777:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787105.913848:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600000 00000100:00100000:2.0:1787787105.913852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600000 00000100:00100000:2.0:1787787105.913887:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787787105.913895:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503600000:12345-0@lo:502: 00000100:00100000:2.0:1787787105.913971:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503600000:12345-0@lo:502: Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.913978:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787787105.914080:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600000:0@lo:502: 00000040:00080000:3.0:1787787105.914121:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787787105.914129:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787787105.914803:0:9533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787105.914812:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787105.914814:0:9533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787105.914820:0:9533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870f5ba1800 00000020:00000080:3.0:1787787105.914822:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787105.914833:0:9533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787105.914836:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787105.914838:0:9533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787787105.914847:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787787105.914977:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787787105.915001:0:9518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787105.915048:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.915060:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.915110:0:9518:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787787105.915113:0:9518:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870f5ba1800 10000000:01000000:2.0:1787787105.915116:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870f5ba1800 10000000:01000000:2.0:1787787105.915120:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787105.915131:0:9518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870f5ba1800 from 1 10000000:01000000:2.0:1787787105.915134:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787787105.915180:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.915188:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.915198:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787105.915214:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600128:0@lo:101: 00000100:00100000:2.0:1787787105.915258:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.915343:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.915513:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600128 00000100:00100000:0.0:1787787105.915520:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600128 00000100:00100000:0.0:1787787105.915669:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787787105.915679:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9518:x1874630503600128:12345-0@lo:101: 00010000:00010000:0.0:1787787105.915690:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787105.915702:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8bc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.915725:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.915735:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.915743:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15c00, rc 0) 00000100:00100000:0.0:1787787105.915790:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600128:12345-0@lo:101: Request processed in 113us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.915797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787787105.915857:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600128:0@lo:101: 00010000:00010000:2.0:1787787105.915870:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.915879:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787105.915964:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600256:0@lo:501: 00000100:00100000:2.0:1787787105.915989:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.916053:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787105.916106:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600256 00000100:00100000:1.0:1787787105.916110:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600256 00000100:00100000:1.0:1787787105.916134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787787105.916169:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600256:12345-0@lo:501: 00000100:00100000:1.0:1787787105.916261:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600256:12345-0@lo:501: Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.916268:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787787105.916465:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600256:0@lo:501: 00000100:00100000:2.0:1787787105.916490:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600384:0@lo:503: 00000100:00100000:2.0:1787787105.916591:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.916614:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.916667:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600384 00000100:00100000:0.0:1787787105.916671:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600384 00000100:00100000:0.0:1787787105.916703:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787787105.916709:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600384:12345-0@lo:503: 00000100:00100000:0.0:1787787105.916780:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600384:12345-0@lo:503: Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.916786:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787787105.916822:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600384:0@lo:503: 00000040:00080000:0.0:1787787105.917039:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787105.917094:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600512:0@lo:502: 00000100:00100000:0.0:1787787105.917127:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.917183:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.917201:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600512 00000100:00100000:0.0:1787787105.917205:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600512 00000100:00100000:0.0:1787787105.917223:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787787105.917228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600512:12345-0@lo:502: 00000100:00100000:0.0:1787787105.917299:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600512:12345-0@lo:502: Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.917316:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787787105.917351:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600512:0@lo:502: 00000040:00080000:0.0:1787787105.917785:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787787105.917809:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787787105.917823:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787787105.917836:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787787105.917848:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787787105.917858:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787787105.917869:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787787105.917880:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787787105.917891:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787787105.917903:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787787105.917915:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787787105.917926:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787787105.917937:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787787105.917951:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787787105.917963:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787787105.917975:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787787105.917989:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787787105.918003:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787787105.918015:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787787105.918029:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787787105.918042:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787787105.918055:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787787105.918077:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787787105.918099:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787787105.918110:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787787105.918120:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787787105.918130:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787787105.918173:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787787105.918190:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787787105.918204:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787787105.918217:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787787105.918230:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787787105.918242:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787787105.918256:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787787105.918269:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787787105.918280:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787787105.918291:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787787105.918303:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787787105.918337:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787787105.918352:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787787105.918657:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787787105.918678:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787787105.918691:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787787105.918704:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787787105.918718:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787787105.918732:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787787105.918767:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600640:0@lo:502: 00000100:00100000:0.0:1787787105.918824:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.918906:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787105.919012:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600640 00000100:00100000:3.0:1787787105.919019:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600640 00000100:00100000:1.0:1787787105.919096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787787105.919107:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600640:12345-0@lo:502: 00000100:00100000:1.0:1787787105.919286:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503600640:12345-0@lo:502: Request processed in 181us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.919294:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787787105.919505:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503600640:0@lo:502: 00000040:00080000:0.0:1787787105.919554:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787787105.919562:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1787787105.920521:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787787105.920536:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9870f57799b8) 00000020:00000080:0.0:1787787105.920567:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1787787105.920729:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870f5ba1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787105.920733:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870f5ba1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787105.920735:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870f5ba1800 3 00010000:00080000:0.0:1787787105.920758:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870fc113800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787105.923907:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1787787105.924259:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787787105.924302:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787105.924336:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x11620bc3f30a8bdd 00000100:00080000:0.0:1787787105.924347:0:9534:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787105.924353:0:9534:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9870fc113800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787105.924388:0:9534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870f5940000 x1874630503600768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787105.924421:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787787105.924494:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503600768:0@lo:38: 00000100:00100000:1.0:1787787105.924575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787787105.924602:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787787105.924690:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff986fc38c19b8) 00000020:00000080:0.0:1787787105.924706:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1787787105.924772:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870f5ba1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787105.924776:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870f5ba1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787105.924779:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870f5ba1800 3 00010000:00080000:0.0:1787787105.924805:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc38bc800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.131@tcp at head 00000100:00080000:1.0:1787787105.925908:0:9535:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff986fc10b03c0 x1874630503600896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787105.925919:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f09c0 going to sleep for 0 seconds 00000100:00100000:2.0:1787787105.926043:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600768 00000100:00100000:2.0:1787787105.926050:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600768 00000100:00100000:2.0:1787787105.926082:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787105.926090:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503600768:12345-0@lo:38: 00010000:00080000:2.0:1787787105.926112:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000100:00100000:1.0:1787787105.926127:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503601408:0@lo:400: 00000020:00000080:2.0:1787787105.926153:0:6529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x11620bc3f30a8beb 00000004:00100000:2.0:1787787105.926170:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787787105.926194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787787105.926202:0:6529:0:(import.c:65:import_set_state_nolock()) ffff986fc2a02800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787105.926221:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503601920:0@lo:400: 00000100:00100000:1.0:1787787105.926242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.926252:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874630503600768:12345-0@lo:38: Request processed in 162us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.926259:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787105.926260:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787787105.926264:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503601024:0@lo:400: 00000100:00100000:2.0:1787787105.926283:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503601152:0@lo:400: 00000100:00100000:1.0:1787787105.926285:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.926300:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503601536:0@lo:400: 00000100:00100000:2.0:1787787105.926325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.926331:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.926344:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503601664:0@lo:400: 00000100:00100000:2.0:1787787105.926364:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.926381:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787105.926386:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503601280:0@lo:400: 00000100:00100000:2.0:1787787105.926407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.926417:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503601792:0@lo:400: 00000100:00100000:2.0:1787787105.926435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.926469:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601024 00000100:00100000:2.0:1787787105.926473:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601024 00000100:00100000:2.0:1787787105.926494:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601536 00000100:00100000:2.0:1787787105.926496:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601536 00000100:00100000:2.0:1787787105.926507:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601664 00000100:00100000:2.0:1787787105.926509:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601664 00000100:00100000:2.0:1787787105.926532:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601280 00000100:00100000:2.0:1787787105.926535:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601280 00000100:00100000:1.0:1787787105.926540:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601920 00000100:00100000:1.0:1787787105.926543:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601920 00000100:00100000:2.0:1787787105.926555:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787787105.926560:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503601024:12345-0@lo:400: 00000100:00100000:1.0:1787787105.926565:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601792 00000100:00100000:1.0:1787787105.926567:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601792 00000100:00100000:1.0:1787787105.926584:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787105.926590:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503601920:12345-0@lo:400: 00000100:00100000:2.0:1787787105.926595:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503601024:12345-0@lo:400: Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.926600:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787105.926632:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503601920:12345-0@lo:400: Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.926638:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787105.926650:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787105.926656:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503601792:12345-0@lo:400: 00000100:00100000:1.0:1787787105.926685:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503601792:12345-0@lo:400: Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.926691:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787787105.927565:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1787787105.927660:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787105.927675:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503601536:12345-0@lo:400: 00000100:00100000:2.0:1787787105.927729:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503601536:12345-0@lo:400: Request processed in 60us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.927736:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787105.927756:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787105.927763:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503601664:12345-0@lo:400: 00000100:00100000:2.0:1787787105.927792:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503601664:12345-0@lo:400: Request processed in 29us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.927798:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787105.927809:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787105.927816:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503601280:12345-0@lo:400: 00000100:00100000:2.0:1787787105.927843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503601280:12345-0@lo:400: Request processed in 28us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.927849:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787105.927872:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601408 00000100:00100000:2.0:1787787105.927877:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601408 00000100:00100000:2.0:1787787105.927898:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503601152 00000100:00100000:2.0:1787787105.927900:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503601152 00000100:00100000:2.0:1787787105.927911:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787105.927917:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503601408:12345-0@lo:400: 00000100:00100000:2.0:1787787105.927948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503601408:12345-0@lo:400: Request processed in 31us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.927959:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787105.927971:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787105.927976:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503601152:12345-0@lo:400: 00000100:00100000:2.0:1787787105.928004:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503601152:12345-0@lo:400: Request processed in 28us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.928009:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787787105.928069:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870f5940000 x1874630503600768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928081:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787787105.928090:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787787105.928098:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787787105.928103:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787105.928106:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787787105.928113:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a12a34ee): req@ffff986fc10b03c0 x1874630503600896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928156:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503600768:0@lo:38: 00010000:00080000:2.0:1787787105.928194:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b03c0 x1874630503601280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928205:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503601280:0@lo:400: 00010000:00080000:2.0:1787787105.928216:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870c327da40 x1874630503601792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928225:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503601792:0@lo:400: 00000100:00100000:2.0:1787787105.928235:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503601152:0@lo:400: 00010000:00080000:2.0:1787787105.928257:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870c327c3c0 x1874630503601664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928265:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503601664:0@lo:400: 00010000:00080000:2.0:1787787105.928322:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3b1680 x1874630503601024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928336:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503601024:0@lo:400: 00010000:00080000:2.0:1787787105.928348:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870c327e580 x1874630503601536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928356:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503601536:0@lo:400: 00000100:00100000:2.0:1787787105.928366:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503601408:0@lo:400: 00010000:00080000:2.0:1787787105.928376:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870c327cb40 x1874630503601920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.928384:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503601920:0@lo:400: 00000100:00100000:1.0:1787787105.928409:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787105.928436:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787105.928449:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503600896 00000100:00100000:2.0:1787787105.928454:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503600896 00000100:00100000:2.0:1787787105.928495:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787105.928502:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1874630503600896:12345-0@lo:901: 00000100:00100000:2.0:1787787105.928584:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1874630503600896:12345-0@lo:901: Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.928590:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787787105.928621:0:9535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc10b03c0 x1874630503600896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787787121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787105.928630:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b03c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1874630503600896:0@lo:901: 00000100:00080000:3.0:1787787105.928864:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1787787105.930089:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787787105.930134:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787105.931038:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x11620bc3f30a8bf2 00000100:00080000:1.0:1787787105.931051:0:9534:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787105.931057:0:9534:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff986fc38bc800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787105.931091:0:9534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3043c0 x1874630503602048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787105.931119:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787787105.931186:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503602048:0@lo:38: 00000100:00100000:2.0:1787787105.931253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.931321:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602048 00000100:00100000:2.0:1787787105.931333:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602048 00000100:00100000:2.0:1787787105.931377:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787105.931383:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503602048:12345-0@lo:38: 00010000:00080000:2.0:1787787105.931415:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787787105.931454:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x11620bc3f30a8bf9 00000004:00100000:2.0:1787787105.931468:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787105.931499:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9870fc38f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787105.931555:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874630503602048:12345-0@lo:38: Request processed in 171us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.931563:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787787105.931609:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc3043c0 x1874630503602048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787105.931620:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787787105.931627:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787787105.931633:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787787105.931638:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787787105.931640:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc38bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787105.931646:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503602048:0@lo:38: 00000040:00080000:1.0:1787787105.939795:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1787787105.940110:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1787787105.940158:0:9518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787105.940176:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787105.940198:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787105.940268:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787105.940270:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787105.940272:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787105.940273:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787105.940275:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787105.940276:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787105.940277:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787105.940279:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787105.940280:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787105.940281:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787105.940283:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787105.940287:0:9518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787787105.940289:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787105.940291:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787105.940292:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787105.940293:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787105.940294:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787105.940295:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787105.940296:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787105.940297:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787105.940298:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787105.940298:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787105.940299:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787105.940338:0:9518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787787105.940356:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503602176:0@lo:253: 00000100:00100000:0.0:1787787105.940425:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787105.940461:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787105.940489:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602176 00000100:00100000:0.0:1787787105.940497:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602176 00000100:00100000:0.0:1787787105.940756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787787105.941243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503602176:12345-0@lo:253: 20000000:01000000:0.0:1787787105.941280:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787787105.941294:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787787105.948784:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787787105.948811:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787787105.949193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:9518:x1874630503602176:12345-0@lo:253: Request processed in 7949us (8762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787105.949205:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787787105.949220:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:697ab143-19fe-4215-afba-68a282afbaf6:9518:1874630503602176:0@lo:253: 10000000:01000000:3.0:1787787105.949234:0:9518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787787105.949237:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787105.949239:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787105.949240:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787105.949242:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787105.949243:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787105.949245:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787105.949246:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787105.949248:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787105.949249:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787105.949251:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787105.949253:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787105.949269:0:9518:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787787105.949399:0:6543:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787105.949405:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787105.949424:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.949440:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.949448:0:6543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.949469:0:6543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.949505:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.949520:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 16 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787105.953022:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3952940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503602304:0@lo:104: 00000100:00100000:2.0:1787787105.953097:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787105.953188:0:6543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.953202:0:6543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787105.953211:0:6543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503602432:0@lo:104: 00000100:00100000:2.0:1787787105.953232:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.953250:0:6543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787105.953517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602304 00000100:00100000:1.0:1787787105.953600:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602304 00000100:00100000:1.0:1787787105.953702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602432 00000100:00100000:1.0:1787787105.953705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602432 00000100:00100000:1.0:1787787105.953720:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787105.953728:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:6543:x1874630503602304:12345-0@lo:104: 00010000:00010000:1.0:1787787105.953741:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.953896:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787105.953903:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:6543:x1874630503602304:12345-0@lo:104: Request processed in 176us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.953910:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787105.953929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787105.953934:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503602432:12345-0@lo:104: 00010000:00010000:1.0:1787787105.953943:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787105.953995:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787105.954000:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:6543:x1874630503602432:12345-0@lo:104: Request processed in 66us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787105.954006:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787105.954890:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3952940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503602304:0@lo:104: 00000100:00100000:2.0:1787787105.954906:0:6543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6543:1874630503602432:0@lo:104: 00010000:00010000:2.0:1787787105.954929:0:6543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.954951:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787105.954957:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955107:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.955111:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955120:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.955127:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.955133:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.955265:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955271:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.955290:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955296:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15600/0x11620bc3f30a8b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8b3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955321:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787105.955324:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955330:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787105.955333:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955349:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787105.955355:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787105.955359:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787105.955453:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955459:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787105.955474:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955481:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8af6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.955494:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.955496:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.955497:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787105.955504:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787105.955518:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503602560:0@lo:103: 00000100:00100000:2.0:1787787105.955578:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.955816:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3952940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503602688:0@lo:103: 00000100:00100000:2.0:1787787105.955843:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787105.955877:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602560 00000100:00100000:2.0:1787787105.955882:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602560 00010000:00010000:2.0:1787787105.955904:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 17 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787105.955939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602688 00000100:00100000:2.0:1787787105.955943:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602688 00010000:00010000:2.0:1787787105.955955:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 18 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787105.955979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787105.959092:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+18:3656:x1874630503602560:12345-0@lo:103: 00010000:00010000:2.0:1787787105.959121:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787105.959131:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959162:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959182:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8b35 expref: 18 pid: 6522 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959199:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787105.959283:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+17:3656:x1874630503602560:12345-0@lo:103: Request processed in 3295us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.959292:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787105.959333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787105.959346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+16:3653:x1874630503602688:12345-0@lo:103: 00010000:00010000:2.0:1787787105.959355:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787105.959361:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959370:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959388:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8aef expref: 16 pid: 6519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959402:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959410:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787787105.959424:0:6514:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010019505s 00010000:00010000:2.0:1787787105.959428:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959434:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959453:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959460:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959465:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787105.959469:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959476:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959492:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959511:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787105.959551:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+15:3653:x1874630503602688:12345-0@lo:103: Request processed in 210us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787105.959558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787105.959606:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3952940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503602688:0@lo:103: 00000100:00100000:2.0:1787787105.959810:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503602560:0@lo:103: 00010000:00010000:2.0:1787787105.959829:0:6543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959836:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787105.959842:0:6543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8c00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787787105.959938:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787787105.960617:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787787105.961319:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787787105.961974:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787787105.962216:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787787105.962439:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787787105.971186:0:9518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787787105.997842:0:9518:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787787105.997852:0:9518:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787787105.997893:0:9518:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787787105.997938:0:9518:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787787105.997957:0:9518:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787787105.998604:0:9518:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787787105.999659:0:9518:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787105.999862:0:9518:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787787106.090230:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787106.665266:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503602816:0@lo:41: 00000100:00100000:1.0:1787787106.665356:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787106.665433:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602816 00000100:00100000:1.0:1787787106.665441:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602816 00000100:00100000:1.0:1787787106.665498:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787787106.665507:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503602816:12345-0@lo:41: 00000004:00000024:1.0:1787787106.665552:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787787106.665595:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503602816:12345-0@lo:41: Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787106.665602:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787787106.665648:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503602816:0@lo:41: 00000020:00000004:0.0:1787787106.977324:0:9591:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787106.977676:0:9591:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787787107.113253:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787107.178258:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787107.178297:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503602944:0@lo:41: 00000100:00100000:2.0:1787787107.178369:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787107.178441:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503602944 00000100:00100000:2.0:1787787107.178449:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503602944 00000100:00100000:2.0:1787787107.178499:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787107.178508:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503602944:12345-0@lo:41: 00000004:00000024:2.0:1787787107.178557:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787787107.178606:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503602944:12345-0@lo:41: Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787107.178624:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787107.178685:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503602944:0@lo:41: 00010000:00010000:2.0:1787787108.142093:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787109.161318:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787109.737317:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503603072:0@lo:13: 00000100:00100000:3.0:1787787109.737397:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787109.737477:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603072 00000100:00100000:3.0:1787787109.737486:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603072 00000100:00100000:1.0:1787787109.737499:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503603200:0@lo:13: 00000100:00100000:1.0:1787787109.737539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787109.737546:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787109.737558:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3568780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503603072:12345-0@lo:13: 00002000:00000024:3.0:1787787109.737590:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787109.737654:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3568780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503603072:12345-0@lo:13: Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787109.737682:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787109.737701:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603200 00000100:00100000:3.0:1787787109.737705:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603200 00010000:00080000:1.0:1787787109.737709:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3568000 x1874630503603072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787109.737726:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787109.737732:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503603072:0@lo:13: 00000100:00100000:3.0:1787787109.737739:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503603200:12345-0@lo:13: 00002000:00000024:3.0:1787787109.737752:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787109.737795:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503603200:12345-0@lo:13: Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787109.737800:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787787109.737816:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787109.737943:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc39521c0 x1874630503603200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787109.737957:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503603200:0@lo:13: 00010000:00010000:2.0:1787787110.186850:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787111.209453:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787111.273444:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503603328:0@lo:400: 00000100:00100000:0.0:1787787111.273517:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.273561:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503603840:0@lo:400: 00000100:00100000:0.0:1787787111.273585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.273602:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503604352:0@lo:400: 00000100:00100000:0.0:1787787111.273624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.273647:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787787111.273653:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503603712:0@lo:400: 00000100:00100000:0.0:1787787111.273674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.273691:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503604224:0@lo:400: 00000100:00100000:0.0:1787787111.273709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.275049:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604352 00000100:00100000:2.0:1787787111.275062:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604352 00000100:00100000:2.0:1787787111.275251:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603712 00000100:00100000:2.0:1787787111.275256:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603712 00000100:00100000:2.0:1787787111.275302:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787111.275311:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503603712:12345-0@lo:400: 00000100:00100000:2.0:1787787111.275386:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503603712:12345-0@lo:400: Request processed in 77us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.275393:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787111.275414:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604224 00000100:00100000:2.0:1787787111.275418:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604224 00000100:00100000:2.0:1787787111.275443:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787111.275449:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503604224:12345-0@lo:400: 00000100:00100000:2.0:1787787111.275478:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503604224:12345-0@lo:400: Request processed in 28us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.275484:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787111.275500:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603840 00000100:00100000:2.0:1787787111.275504:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603840 00000100:00100000:2.0:1787787111.275524:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787111.275530:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503603840:12345-0@lo:400: 00000100:00100000:2.0:1787787111.275558:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503603840:12345-0@lo:400: Request processed in 29us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.275576:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787111.275594:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603328 00000100:00100000:2.0:1787787111.275598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603328 00000100:00100000:2.0:1787787111.275619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787787111.275624:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:3654:x1874630503603328:12345-0@lo:400: 00000100:00100000:2.0:1787787111.275652:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:3654:x1874630503603328:12345-0@lo:400: Request processed in 28us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.275658:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787787111.275688:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503603584:0@lo:400: 00000100:00100000:2.0:1787787111.275717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.275737:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503604096:0@lo:400: 00000100:00100000:2.0:1787787111.275757:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.275772:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503604608:0@lo:400: 00000100:00100000:2.0:1787787111.275789:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.275807:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787787111.275813:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f59412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503603456:0@lo:400: 00000100:00100000:2.0:1787787111.275832:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.275848:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503603968:0@lo:400: 00000100:00100000:2.0:1787787111.275866:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.275875:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503604480:0@lo:400: 00000100:00100000:2.0:1787787111.275907:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787787111.277178:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e630c0 x1874630503603712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.277212:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503603712:0@lo:400: 00010000:00080000:0.0:1787787111.277230:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e60f00 x1874630503604224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.277262:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503604224:0@lo:400: 00000100:00100000:0.0:1787787111.277275:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503603328:0@lo:400: 00000100:00100000:0.0:1787787111.277287:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503603840:0@lo:400: 00000100:00080000:3.0:1787787111.279027:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787111.280576:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603584 00000100:00100000:0.0:1787787111.280592:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603584 00000100:00100000:0.0:1787787111.280645:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787111.280656:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503603584:12345-0@lo:400: 00000100:00100000:0.0:1787787111.280745:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503603584:12345-0@lo:400: Request processed in 92us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.280752:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787111.280779:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604096 00000100:00100000:0.0:1787787111.280783:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604096 00000100:00100000:0.0:1787787111.280816:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604608 00000100:00100000:0.0:1787787111.280819:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604608 00000100:00100000:0.0:1787787111.280833:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603456 00000100:00100000:0.0:1787787111.280836:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603456 00000100:00100000:0.0:1787787111.280846:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503603968 00000100:00100000:0.0:1787787111.280848:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503603968 00000100:00100000:0.0:1787787111.280861:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604480 00000100:00100000:0.0:1787787111.280863:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604480 00000100:00100000:0.0:1787787111.280877:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787111.280883:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3952580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503604096:12345-0@lo:400: 00000100:00100000:0.0:1787787111.280929:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3952580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503604096:12345-0@lo:400: Request processed in 45us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.280935:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787111.280947:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787111.280953:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503604608:12345-0@lo:400: 00000100:00100000:0.0:1787787111.280986:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503604608:12345-0@lo:400: Request processed in 34us (5196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.280991:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787111.281002:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787111.281007:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503603456:12345-0@lo:400: 00000100:00100000:0.0:1787787111.281030:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503603456:12345-0@lo:400: Request processed in 23us (5197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.281035:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787111.281045:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787111.281050:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3952d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503603968:12345-0@lo:400: 00000100:00100000:0.0:1787787111.281075:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3952d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503603968:12345-0@lo:400: Request processed in 24us (5208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.282267:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787111.282293:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787111.282304:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503604480:12345-0@lo:400: 00000100:00100000:0.0:1787787111.282350:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503604480:12345-0@lo:400: Request processed in 50us (6442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.282356:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787111.282408:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787111.282415:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503604352:12345-0@lo:400: 00000100:00100000:0.0:1787787111.282450:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503604352:12345-0@lo:400: Request processed in 35us (8825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.282456:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787787111.282483:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787111.282487:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787787111.282518:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ebc00 x1874630503604352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.282541:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503604352:0@lo:400: 00010000:00080000:2.0:1787787111.283500:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f59412c0 x1874630503603456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787111.283513:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f59412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503603456:0@lo:400: 00010000:00080000:2.0:1787787111.283538:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e63480 x1874630503603968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787111.283549:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503603968:0@lo:400: 00010000:00080000:2.0:1787787111.283566:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36eb840 x1874630503604480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787111.283574:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503604480:0@lo:400: 00000100:00100000:2.0:1787787111.283587:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503603584:0@lo:400: 00010000:00080000:2.0:1787787111.283600:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e63c00 x1874630503604096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787111.283610:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503604096:0@lo:400: 00010000:00080000:2.0:1787787111.283627:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e9e00 x1874630503604608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787111.283636:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503604608:0@lo:400: 10000000:01000000:0.0:1787787111.786314:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787787111.786322:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870fc17b800 from 39 10000000:01000000:0.0:1787787111.786328:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787787111.786376:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.786389:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.786402:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787111.786431:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503604864:0@lo:101: 00000100:00100000:0.0:1787787111.786491:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.786550:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.786564:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787111.786575:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503604736:0@lo:41: 00000100:00100000:0.0:1787787111.786602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.786641:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604736 00000100:00100000:0.0:1787787111.786649:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604736 00000100:00100000:0.0:1787787111.786691:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787111.786701:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503604736:12345-0@lo:41: 00000004:00000024:0.0:1787787111.786732:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787787111.786776:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503604736:12345-0@lo:41: Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.786783:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787111.786818:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503604736:0@lo:41: 00000100:00100000:1.0:1787787111.786983:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604864 00000100:00100000:1.0:1787787111.786989:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604864 00000100:00100000:1.0:1787787111.787029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787787111.787036:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503604864:12345-0@lo:101: 00010000:00010000:1.0:1787787111.787045:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787111.787057:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.787091:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.787101:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.787110:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e800, rc 0) 00000100:00100000:1.0:1787787111.787163:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503604864:12345-0@lo:101: Request processed in 127us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.787169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787787111.787380:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503604864:0@lo:101: 00010000:00010000:0.0:1787787111.787394:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.787402:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787111.787592:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503604992:0@lo:501: 00000100:00100000:0.0:1787787111.787682:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.787715:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.787762:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503604992 00000100:00100000:1.0:1787787111.787766:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503604992 00000100:00100000:1.0:1787787111.787798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787787111.787805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503604992:12345-0@lo:501: 00000100:00100000:1.0:1787787111.787909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503604992:12345-0@lo:501: Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.787916:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787787111.787981:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503604992:0@lo:501: 00000100:00100000:0.0:1787787111.788008:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605120:0@lo:503: 00000100:00100000:0.0:1787787111.788048:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.788071:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.788111:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605120 00000100:00100000:1.0:1787787111.788115:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605120 00000100:00100000:1.0:1787787111.788179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787787111.788185:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503605120:12345-0@lo:503: 00000100:00100000:1.0:1787787111.788269:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503605120:12345-0@lo:503: Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.788275:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787787111.788735:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605120:0@lo:503: 00000100:00100000:1.0:1787787111.794049:0:9828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9828:1874630503605248:0@lo:502: 00000100:00100000:1.0:1787787111.794170:0:9828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.794238:0:9828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.794390:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605248 00000100:00100000:3.0:1787787111.794398:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605248 00000100:00100000:3.0:1787787111.794610:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787787111.794628:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9828:x1874630503605248:12345-0@lo:502: 00000100:00100000:3.0:1787787111.794756:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:9828:x1874630503605248:12345-0@lo:502: Request processed in 137us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.794764:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787787111.797388:0:9828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9828:1874630503605248:0@lo:502: 00000100:00100000:1.0:1787787111.797690:0:9828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9828:1874630503605376:0@lo:502: 00000100:00100000:1.0:1787787111.797759:0:9828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.797799:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605376 00000100:00100000:1.0:1787787111.797806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605376 00000100:00100000:1.0:1787787111.797847:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787111.797855:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9828:x1874630503605376:12345-0@lo:502: 00000100:00100000:1.0:1787787111.797960:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:9828:x1874630503605376:12345-0@lo:502: Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.797967:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787111.798011:0:9828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.798023:0:9828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9828:1874630503605376:0@lo:502: 00000040:00080000:1.0:1787787111.798040:0:9828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787787111.801286:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787787111.801333:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787111.801345:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.801357:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787111.801367:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787787111.801379:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787787111.801382:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787111.801566:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.801590:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.801602:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.801624:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605504:0@lo:101: 00000100:00100000:1.0:1787787111.801685:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.801724:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.802231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605504 00000100:00100000:2.0:1787787111.802240:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605504 00000100:00100000:2.0:1787787111.802285:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787787111.802294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503605504:12345-0@lo:101: 00010000:00010000:2.0:1787787111.802307:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787111.802319:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c15 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.802341:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.802351:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.802366:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391600, rc 0) 00000100:00100000:2.0:1787787111.802641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503605504:12345-0@lo:101: Request processed in 348us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.802649:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787787111.802862:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605504:0@lo:101: 00010000:00010000:1.0:1787787111.802876:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.802885:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.802943:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605632:0@lo:501: 00000100:00100000:1.0:1787787111.803067:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.803093:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.803267:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605632 00000100:00100000:2.0:1787787111.803273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605632 00000100:00100000:2.0:1787787111.803306:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787787111.803313:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503605632:12345-0@lo:501: 00000100:00100000:2.0:1787787111.803538:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503605632:12345-0@lo:501: Request processed in 224us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.803546:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787787111.803612:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605632:0@lo:501: 00000100:00100000:1.0:1787787111.803639:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605760:0@lo:503: 00000100:00100000:1.0:1787787111.803679:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.808674:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.809299:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605760 00000100:00100000:2.0:1787787111.809312:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605760 00000100:00100000:2.0:1787787111.809367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787787111.809376:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503605760:12345-0@lo:503: 00000100:00100000:2.0:1787787111.809622:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503605760:12345-0@lo:503: Request processed in 246us (5941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.809629:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787787111.809691:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503605760:0@lo:503: 00000100:00100000:1.0:1787787111.811775:0:9831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9831:1874630503605888:0@lo:502: 00000100:00100000:1.0:1787787111.811851:0:9831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.812314:0:9831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.817073:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503605888 00000100:00100000:2.0:1787787111.817089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503605888 00000100:00100000:2.0:1787787111.817543:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787787111.817556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:9831:x1874630503605888:12345-0@lo:502: 00000100:00100000:2.0:1787787111.817718:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:9831:x1874630503605888:12345-0@lo:502: Request processed in 165us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.817735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787787111.817838:0:9831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9831:1874630503605888:0@lo:502: 00000020:01000000:0.0:1787787111.817870:0:9831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787111.817879:0:9831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787111.817881:0:9831:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787111.817885:0:9831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787111.817887:0:9831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787787111.817915:0:9831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9831:1874630503606016:0@lo:502: 00000100:00100000:0.0:1787787111.817956:0:9831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.819518:0:9831:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.819842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606016 00000100:00100000:3.0:1787787111.819850:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606016 00000100:00100000:3.0:1787787111.819895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787787111.819904:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:9831:x1874630503606016:12345-0@lo:502: 00000100:00100000:3.0:1787787111.820066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:9831:x1874630503606016:12345-0@lo:502: Request processed in 163us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.820073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787787111.821253:0:9831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9831:1874630503606016:0@lo:502: 00000020:01000000:0.0:1787787111.821296:0:9831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787111.821303:0:9831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787111.821305:0:9831:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787787111.821309:0:9831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787787111.821614:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787787111.821632:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787787111.821643:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.821653:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787111.821663:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787787111.821665:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870d2373000 from 39 10000000:01000000:2.0:1787787111.821668:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787787111.821698:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.821706:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.821715:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787111.821733:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606144:0@lo:101: 00000100:00100000:2.0:1787787111.821790:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.821865:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.826215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606144 00000100:00100000:1.0:1787787111.826235:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606144 00000100:00100000:0.0:1787787111.829087:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787787111.829497:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503606144:12345-0@lo:101: 00010000:00010000:0.0:1787787111.829519:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787111.829540:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.829568:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.829580:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.829589:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14800, rc 0) 00000100:00100000:0.0:1787787111.830514:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503606144:12345-0@lo:101: Request processed in 1411us (8721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.830523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787787111.832915:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606144:0@lo:101: 00010000:00010000:2.0:1787787111.832948:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.832960:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787111.833062:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606272:0@lo:501: 00000100:00100000:2.0:1787787111.833285:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.833334:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.833447:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606272 00000100:00100000:0.0:1787787111.833454:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606272 00000100:00100000:0.0:1787787111.833501:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787787111.833510:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503606272:12345-0@lo:501: 00000100:00100000:0.0:1787787111.833646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503606272:12345-0@lo:501: Request processed in 136us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.833653:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787787111.833830:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606272:0@lo:501: 00000100:00100000:2.0:1787787111.833860:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606400:0@lo:503: 00000100:00100000:2.0:1787787111.833902:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.833924:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.835263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606400 00000100:00100000:0.0:1787787111.835281:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606400 00000100:00100000:0.0:1787787111.835337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787787111.835347:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503606400:12345-0@lo:503: 00000100:00100000:0.0:1787787111.838787:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503606400:12345-0@lo:503: Request processed in 3431us (4875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.838803:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787787111.838943:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606400:0@lo:503: 00000100:00100000:2.0:1787787111.852665:0:9834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9834:1874630503606528:0@lo:502: 00000100:00100000:2.0:1787787111.852747:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.852795:0:9834:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.852901:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606528 00000100:00100000:3.0:1787787111.852909:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606528 00000100:00100000:3.0:1787787111.852965:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787787111.852974:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:9834:x1874630503606528:12345-0@lo:502: 00000100:00100000:3.0:1787787111.853097:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:9834:x1874630503606528:12345-0@lo:502: Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.853104:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787787111.853274:0:9834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9834:1874630503606528:0@lo:502: 00000100:00100000:0.0:1787787111.853321:0:9834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9834:1874630503606656:0@lo:502: 00000100:00100000:0.0:1787787111.853356:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.853380:0:9834:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.853483:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606656 00000100:00100000:3.0:1787787111.853488:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606656 00000100:00100000:3.0:1787787111.853517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787787111.853523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:9834:x1874630503606656:12345-0@lo:502: 00000100:00100000:3.0:1787787111.853586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:9834:x1874630503606656:12345-0@lo:502: Request processed in 62us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.853592:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787111.853708:0:9834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9834:1874630503606656:0@lo:502: 00000040:00080000:0.0:1787787111.853728:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787787111.855051:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787787111.855080:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787787111.855090:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.855104:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787111.855114:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787787111.855116:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870d2373000 from 6 10000000:01000000:3.0:1787787111.855119:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787787111.855175:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.855184:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.855222:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787111.855242:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606784:0@lo:101: 00000100:00100000:3.0:1787787111.855295:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.855330:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.855390:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606784 00000100:00100000:0.0:1787787111.855398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606784 00000100:00100000:0.0:1787787111.855453:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787787111.855462:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503606784:12345-0@lo:101: 00010000:00010000:0.0:1787787111.855472:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787111.855485:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8c38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.855504:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c31 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.855515:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c31 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.855523:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14a00, rc 0) 00000100:00100000:0.0:1787787111.855760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503606784:12345-0@lo:101: Request processed in 298us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.855768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787787111.862564:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606784:0@lo:101: 00010000:00010000:2.0:1787787111.862596:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.862609:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787111.870579:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606912:0@lo:256: 00000100:00100000:3.0:1787787111.870654:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.870695:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.870731:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503606912 00000100:00100000:3.0:1787787111.870739:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503606912 00000100:00100000:3.0:1787787111.870786:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787111.870796:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503606912:12345-0@lo:256: 20000000:01000000:3.0:1787787111.870815:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787787111.870832:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787787111.870836:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787787111.870918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503606912:12345-0@lo:256: Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.870925:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787111.870986:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503606912:0@lo:256: 10000000:01000000:3.0:1787787111.871032:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787111.871042:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.871052:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787111.871070:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787787111.871073:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1787787111.871076:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787787111.871097:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.871117:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.871126:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787111.871158:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503607040:0@lo:101: 00000100:00100000:3.0:1787787111.871186:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.871213:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.871545:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607040 00000100:00100000:0.0:1787787111.871551:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607040 00000100:00100000:0.0:1787787111.871582:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787787111.871589:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503607040:12345-0@lo:101: 00010000:00010000:0.0:1787787111.871598:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787111.871610:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.871631:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.871643:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.871651:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15600, rc 0) 00000100:00100000:0.0:1787787111.871682:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503607040:12345-0@lo:101: Request processed in 94us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.871687:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787111.871838:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503607040:0@lo:101: 00010000:00010000:3.0:1787787111.871849:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787111.871858:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787111.871909:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503607168:0@lo:501: 00000100:00100000:3.0:1787787111.871933:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.871956:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.872034:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607168 00000100:00100000:0.0:1787787111.872038:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607168 00000100:00100000:0.0:1787787111.872064:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787787111.872071:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503607168:12345-0@lo:501: 00000100:00100000:0.0:1787787111.872202:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503607168:12345-0@lo:501: Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.872210:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787111.872283:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503607168:0@lo:501: 00000100:00100000:3.0:1787787111.872309:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503607296:0@lo:503: 00000100:00100000:3.0:1787787111.872352:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.872372:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.872408:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607296 00000100:00100000:0.0:1787787111.872427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607296 00000100:00100000:0.0:1787787111.872457:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787787111.872463:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503607296:12345-0@lo:503: 00000100:00100000:0.0:1787787111.872536:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503607296:12345-0@lo:503: Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.872542:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787787111.872656:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503607296:0@lo:503: 00000100:00100000:3.0:1787787111.886125:0:9839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9839:1874630503607424:0@lo:502: 00000100:00100000:3.0:1787787111.886242:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.886278:0:9839:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.886334:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607424 00000100:00100000:2.0:1787787111.886341:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607424 00000100:00100000:2.0:1787787111.886400:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787787111.886534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:9839:x1874630503607424:12345-0@lo:502: 00000100:00100000:2.0:1787787111.886674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:9839:x1874630503607424:12345-0@lo:502: Request processed in 258us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.886691:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787787111.886772:0:9839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9839:1874630503607424:0@lo:502: 00000020:01000000:3.0:1787787111.886797:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787111.886804:0:9839:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787787111.886810:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787111.886812:0:9839:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787787111.886816:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787787111.886820:0:9839:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:3.0:1787787111.886843:0:9839:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787787111.886846:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787111.886861:0:9839:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9870f55f3370) 00000020:00000080:3.0:1787787111.886886:0:9839:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787787111.886890:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787787111.886964:0:9839:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787787111.886969:0:9839:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787787111.886976:0:9839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a8c54 00010000:00080000:3.0:1787787111.887000:0:9839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870ff9be000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787111.887247:0:9839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1787787111.887371:0:9839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787787111.887381:0:9839:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787787111.887533:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787111.887631:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787111.887742:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787787111.887827:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787787111.889172:0:9840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787111.889177:0:9840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787787111.889790:0:9839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787111.889803:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787787111.889840:0:9839:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787787111.889865:0:9839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a8c5b 00000100:00080000:2.0:1787787111.889875:0:9839:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787111.889881:0:9839:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870ff9be000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787111.889917:0:9839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc39521c0 x1874630503607552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787111.889946:0:9839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787787111.890000:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787111.890004:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787111.890006:0:9839:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787787111.890009:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787111.890013:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787111.890014:0:9839:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787787111.890017:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787787111.890019:0:9839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787787111.890044:0:9839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9839:1874630503607680:0@lo:502: 00000100:00100000:2.0:1787787111.890118:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.890176:0:9839:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.890336:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503607552:0@lo:8: 00000100:00100000:3.0:1787787111.890383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.890428:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607680 00000100:00100000:3.0:1787787111.890435:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607680 00000100:00100000:3.0:1787787111.890476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787787111.890485:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:9839:x1874630503607680:12345-0@lo:502: 00000100:00100000:3.0:1787787111.890615:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:9839:x1874630503607680:12345-0@lo:502: Request processed in 130us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.890623:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787787111.891279:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503608192:0@lo:400: 00000100:00100000:0.0:1787787111.891314:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.891334:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503608704:0@lo:400: 00000100:00100000:3.0:1787787111.891521:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503607808:0@lo:400: 00000100:00100000:3.0:1787787111.891552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.891571:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503608320:0@lo:400: 00000100:00100000:3.0:1787787111.891591:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.891608:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503608832:0@lo:400: 00000100:00100000:3.0:1787787111.891629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.891659:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607808 00000100:00100000:3.0:1787787111.891663:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607808 00000100:00100000:3.0:1787787111.891688:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608320 00000100:00100000:3.0:1787787111.891691:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608320 00000100:00100000:3.0:1787787111.891702:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608832 00000100:00100000:3.0:1787787111.891704:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608832 00000100:00100000:3.0:1787787111.891716:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787111.891722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc35692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503607808:12345-0@lo:400: 00000100:00100000:3.0:1787787111.891757:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc35692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503607808:12345-0@lo:400: Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.891772:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787111.891786:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787111.891791:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3568b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503608320:12345-0@lo:400: 00000100:00100000:3.0:1787787111.891817:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3568b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503608320:12345-0@lo:400: Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.891822:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787111.891831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787111.891837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503608832:12345-0@lo:400: 00000100:00100000:3.0:1787787111.891861:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503608832:12345-0@lo:400: Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.891867:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787787111.891901:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ebc00 x1874630503607808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.891914:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503607808:0@lo:400: 00010000:00080000:3.0:1787787111.891924:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e9a40 x1874630503608320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.891932:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503608320:0@lo:400: 00010000:00080000:3.0:1787787111.891939:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ea1c0 x1874630503608832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.891947:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503608832:0@lo:400: 00000100:00100000:2.0:1787787111.893556:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607552 00000100:00100000:2.0:1787787111.893568:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607552 00000100:00100000:2.0:1787787111.893623:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787111.893632:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503607552:12345-0@lo:8: 00010000:00080000:2.0:1787787111.893666:0:8444:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1787787111.893698:0:8444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a8c62 00002000:00100000:2.0:1787787111.893714:0:8444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9870f5ba5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787787111.893730:0:8444:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787787111.893734:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787787111.893795:0:8444:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787787111.894015:0:8444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787787111.894044:0:8444:0:(import.c:65:import_set_state_nolock()) ffff9870f5ba6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787111.894129:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503607552:12345-0@lo:8: Request processed in 496us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.894154:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787111.894212:0:9839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9839:1874630503607680:0@lo:502: 00000020:01000000:2.0:1787787111.894251:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787111.894257:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787111.894260:0:9839:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787787111.894263:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1787787111.894495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.894551:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503607936:0@lo:400: 00000100:00100000:0.0:1787787111.894588:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.894609:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503608448:0@lo:400: 00000100:00100000:0.0:1787787111.894633:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.894652:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503608960:0@lo:400: 00000100:00100000:0.0:1787787111.894676:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.894696:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787787111.894703:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503608064:0@lo:400: 00000100:00100000:0.0:1787787111.894724:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.894741:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503608576:0@lo:400: 00000100:00100000:0.0:1787787111.894761:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.894789:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608192 00000100:00100000:0.0:1787787111.894795:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608192 00000100:00100000:0.0:1787787111.894818:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503607936 00000100:00100000:0.0:1787787111.894820:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503607936 00000100:00100000:0.0:1787787111.894833:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787787111.894840:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503608192:12345-0@lo:400: 00000100:00100000:0.0:1787787111.894892:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503608192:12345-0@lo:400: Request processed in 51us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.894899:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787787111.894915:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787111.894920:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503607936:12345-0@lo:400: 00000100:00100000:0.0:1787787111.894951:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503607936:12345-0@lo:400: Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.894957:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787787111.895513:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc39521c0 x1874630503607552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.895525:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787111.895539:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787787111.895547:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787787111.895552:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787787111.895555:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9be000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787787111.895568:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787787111.895574:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503607552:0@lo:8: 00000004:00080000:3.0:1787787111.895598:0:9840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787787111.895658:0:9840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 256077519023ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787787111.895664:0:9840:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:1.0:1787787111.895748:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1787787111.895773:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787787111.895783:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.895793:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787111.895803:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787787111.895805:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c3240800 from 39 10000000:01000000:1.0:1787787111.895808:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787111.895838:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.895846:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.895855:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.895870:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609088:0@lo:101: 00000100:00100000:1.0:1787787111.895916:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.895948:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5f7ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.895964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609088 00000100:00100000:1.0:1787787111.895967:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609088 00000100:00100000:1.0:1787787111.896016:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787787111.896025:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503609088:12345-0@lo:101: 00010000:00010000:1.0:1787787111.896034:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787111.896053:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.896074:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.896086:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.896094:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454f400, rc 0) 00000100:00100000:1.0:1787787111.896124:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503609088:12345-0@lo:101: Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.896131:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787787111.896210:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609088:0@lo:101: 00010000:00010000:1.0:1787787111.896222:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.896231:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.896279:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609216:0@lo:501: 00000100:00100000:1.0:1787787111.896303:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.896322:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.896334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609216 00000100:00100000:1.0:1787787111.896337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609216 00000100:00100000:1.0:1787787111.896373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787787111.896381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503609216:12345-0@lo:501: 00000100:00100000:1.0:1787787111.897894:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503609216:12345-0@lo:501: Request processed in 1507us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.897914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787787111.898086:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503609344:0@lo:700: 00000100:00100000:3.0:1787787111.898121:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.898167:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609344 00000100:00100000:3.0:1787787111.898172:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609344 00000100:00100000:3.0:1787787111.898228:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787111.898237:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc35683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9841:x1874630503609344:12345-0@lo:700: 00000100:00100000:3.0:1787787111.898269:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8451:1874630503609472:0@lo:700: 00000100:00100000:3.0:1787787111.898295:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.898312:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.898328:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609472 00000100:00100000:3.0:1787787111.898331:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609472 00000100:00100000:3.0:1787787111.898374:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787111.898382:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8451:x1874630503609472:12345-0@lo:700: 00000100:00100000:3.0:1787787111.898491:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7cb3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.898602:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608704 00000100:00100000:2.0:1787787111.898607:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608704 00000100:00100000:2.0:1787787111.898644:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608576 00000100:00100000:2.0:1787787111.898647:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608576 00000100:00100000:2.0:1787787111.898661:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787111.898667:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503608704:12345-0@lo:400: 00000100:00100000:2.0:1787787111.898707:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503608704:12345-0@lo:400: Request processed in 41us (7353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.898713:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787111.898724:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787111.898729:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f59412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503608576:12345-0@lo:400: 00000100:00100000:2.0:1787787111.898754:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f59412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503608576:12345-0@lo:400: Request processed in 25us (3992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.898759:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787111.898786:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608448 00000100:00100000:2.0:1787787111.898789:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608448 00000100:00100000:2.0:1787787111.898807:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608960 00000100:00100000:2.0:1787787111.898810:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608960 00000100:00100000:2.0:1787787111.898819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503608064 00000100:00100000:2.0:1787787111.898822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503608064 00000100:00100000:2.0:1787787111.898835:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787111.898841:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503608448:12345-0@lo:400: 00000100:00100000:2.0:1787787111.898872:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503608448:12345-0@lo:400: Request processed in 31us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.898878:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787111.898889:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787111.898895:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503608960:12345-0@lo:400: 00000100:00100000:2.0:1787787111.898921:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503608960:12345-0@lo:400: Request processed in 27us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.898927:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787111.898937:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787111.898943:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503608064:12345-0@lo:400: 00000100:00100000:2.0:1787787111.898971:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503608064:12345-0@lo:400: Request processed in 28us (4245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.898976:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787787111.905839:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503608192:0@lo:400: 00010000:00080000:0.0:1787787111.905860:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8000 x1874630503608704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.905871:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503608704:0@lo:400: 00010000:00080000:0.0:1787787111.905916:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e9680 x1874630503608064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.905925:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503608064:0@lo:400: 00010000:00080000:0.0:1787787111.905937:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ea940 x1874630503608576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.905945:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503608576:0@lo:400: 00000100:00100000:0.0:1787787111.905963:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503607936:0@lo:400: 00010000:00080000:0.0:1787787111.906564:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8780 x1874630503608448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.906575:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503608448:0@lo:400: 00010000:00080000:0.0:1787787111.906589:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36eb480 x1874630503608960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.906607:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503608960:0@lo:400: 00000100:00080000:0.0:1787787111.906851:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787111.907545:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609216:0@lo:501: 00000100:00100000:1.0:1787787111.907594:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609600:0@lo:503: 00000100:00100000:1.0:1787787111.907669:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787111.907718:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609600 00000100:00100000:1.0:1787787111.907720:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.907727:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609600 40000000:02000000:3.0:1787787111.907794:0:6534:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787787111.907850:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787787111.907864:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503609600:12345-0@lo:503: 00000100:00100000:2.0:1787787111.907974:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503609600:12345-0@lo:503: Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.907982:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787787111.908649:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609600:0@lo:503: 00000100:00100000:1.0:1787787111.909598:0:9842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9842:1874630503609728:0@lo:502: 00000100:00100000:1.0:1787787111.909654:0:9842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.909687:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609728 00000100:00100000:1.0:1787787111.909693:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609728 00000100:00100000:1.0:1787787111.909731:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787787111.909740:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:9842:x1874630503609728:12345-0@lo:502: 00000100:00100000:1.0:1787787111.909828:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:9842:x1874630503609728:12345-0@lo:502: Request processed in 88us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.909836:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787787111.909885:0:9842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.909899:0:9842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9842:1874630503609728:0@lo:502: 00000100:00100000:1.0:1787787111.909942:0:9842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9842:1874630503609856:0@lo:502: 00000100:00100000:1.0:1787787111.909975:0:9842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.909996:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609856 00000100:00100000:1.0:1787787111.909999:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609856 00000100:00100000:1.0:1787787111.910022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787787111.910028:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:9842:x1874630503609856:12345-0@lo:502: 00000100:00100000:1.0:1787787111.910092:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:9842:x1874630503609856:12345-0@lo:502: Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.910105:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787787111.910134:0:9842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.910164:0:9842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9842:1874630503609856:0@lo:502: 00000040:00080000:1.0:1787787111.910182:0:9842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787787111.910246:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787787111.910264:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787111.910273:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.910283:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787111.910292:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787111.910295:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c3240800 from 6 10000000:01000000:1.0:1787787111.910298:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787111.910320:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.910329:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.910338:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.910350:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609984:0@lo:101: 00000100:00100000:1.0:1787787111.910390:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.910407:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1787787111.910898:0:7458:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787787111.910936:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503609984 00000100:00100000:2.0:1787787111.910941:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503609984 00000100:00100000:2.0:1787787111.910971:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787787111.910978:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503609984:12345-0@lo:101: 00010000:00010000:2.0:1787787111.910987:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787111.911000:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.911023:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c77 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.911035:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c77 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787111.911044:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391800, rc 0) 00000100:00100000:2.0:1787787111.911073:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503609984:12345-0@lo:101: Request processed in 97us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.911080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787787111.913873:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503609984:0@lo:101: 00010000:00010000:1.0:1787787111.913921:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.913934:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.914006:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610112:0@lo:256: 00000100:00100000:1.0:1787787111.914069:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.914123:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.914167:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610112 00000100:00100000:1.0:1787787111.914174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610112 00000100:00100000:1.0:1787787111.914232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787787111.914241:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503610112:12345-0@lo:256: 20000000:01000000:1.0:1787787111.914260:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787111.914277:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787111.914280:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787787111.917581:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503610112:12345-0@lo:256: Request processed in 3330us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.917598:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787787111.917692:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610112:0@lo:256: 10000000:01000000:1.0:1787787111.917757:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787111.917767:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.917779:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787111.917790:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787787111.917800:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787787111.917803:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787111.917837:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.917845:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787111.917855:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787111.917874:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610240:0@lo:101: 00000100:00100000:1.0:1787787111.917922:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.917962:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.918269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610240 00000100:00100000:0.0:1787787111.918276:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610240 00000100:00100000:0.0:1787787111.918317:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787787111.918326:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503610240:12345-0@lo:101: 00010000:00010000:0.0:1787787111.918338:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787111.918483:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8c85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.918520:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.918530:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.918539:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b200, rc 0) 00000100:00100000:0.0:1787787111.918581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503610240:12345-0@lo:101: Request processed in 256us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.918588:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787787111.920238:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610240:0@lo:101: 00010000:00010000:0.0:1787787111.920262:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.920273:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787111.920374:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610368:0@lo:501: 00000100:00100000:0.0:1787787111.920421:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.920458:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787111.920539:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610368 00000100:00100000:2.0:1787787111.920546:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610368 00000100:00100000:2.0:1787787111.920591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787787111.920600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503610368:12345-0@lo:501: 00000100:00100000:2.0:1787787111.920714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503610368:12345-0@lo:501: Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.920722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787787111.923576:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610368:0@lo:501: 00000100:00100000:0.0:1787787111.923632:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610496:0@lo:503: 00000100:00100000:0.0:1787787111.923704:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.923739:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.923756:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610496 00000100:00100000:0.0:1787787111.923761:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610496 00000100:00100000:0.0:1787787111.923802:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787787111.923810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503610496:12345-0@lo:503: 00000100:00100000:0.0:1787787111.923916:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503610496:12345-0@lo:503: Request processed in 105us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.923924:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787787111.923983:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503610496:0@lo:503: 00000100:00100000:0.0:1787787111.924214:0:9846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9846:1874630503610624:0@lo:502: 00000100:00100000:0.0:1787787111.924246:0:9846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.924265:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610624 00000100:00100000:0.0:1787787111.924269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610624 00000100:00100000:0.0:1787787111.924298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787787111.924306:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:9846:x1874630503610624:12345-0@lo:502: 00000100:00100000:3.0:1787787111.925045:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8451:x1874630503609472:12345-0@lo:700: Request processed in 26661us (26745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.925055:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787787111.925098:0:8451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356b0c0 x1874630503609472/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.925110:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8451:1874630503609472:0@lo:700: 40000000:02000000:3.0:1787787111.925119:0:8451:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1787787111.926215:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:9846:x1874630503610624:12345-0@lo:502: Request processed in 1906us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.926225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787787111.926353:0:9846:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.926386:0:9846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9846:1874630503610624:0@lo:502: 00000020:01000000:0.0:1787787111.926415:0:9846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787111.926422:0:9846:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787787111.926429:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787111.926432:0:9846:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787787111.926437:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787111.926440:0:9846:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:0.0:1787787111.926462:0:9846:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787787111.926465:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787111.926479:0:9846:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff986fc38c4d28) 00000020:00000080:0.0:1787787111.926501:0:9846:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1787787111.926506:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787111.926593:0:9846:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787787111.926599:0:9846:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787787111.926606:0:9846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a8c9a 00010000:00080000:0.0:1787787111.926634:0:9846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870fc388000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787111.926861:0:9846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1787787111.926993:0:9846:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787787111.927006:0:9846:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787787111.927220:0:9846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787111.927373:0:9846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787111.927504:0:9846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787787111.927631:0:9846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787787111.936992:0:9847:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787111.937002:0:9847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787787111.937917:0:9846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787111.937929:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787111.937965:0:9846:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787787111.938004:0:9846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a8ca1 00000100:00080000:0.0:1787787111.938015:0:9846:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787111.938028:0:9846:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870fc388000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787111.938064:0:9846:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870f5943840 x1874630503610752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787111.938086:0:9846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787787111.938170:0:9846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787111.938175:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787111.938176:0:9846:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787787111.938179:0:9846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787111.938183:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787111.938185:0:9846:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787111.938188:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787111.938200:0:9846:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787787111.938228:0:9846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9846:1874630503610880:0@lo:502: 00000100:00100000:0.0:1787787111.938315:0:9846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.938350:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610880 00000100:00100000:0.0:1787787111.938356:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610880 00000100:00100000:0.0:1787787111.938394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787787111.938402:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:9846:x1874630503610880:12345-0@lo:502: 00000100:00100000:0.0:1787787111.938501:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:9846:x1874630503610880:12345-0@lo:502: Request processed in 100us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.938508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787787111.938554:0:9846:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.938575:0:9846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:9846:1874630503610880:0@lo:502: 00000020:01000000:0.0:1787787111.938599:0:9846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787111.938603:0:9846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787111.938605:0:9846:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787787111.938608:0:9846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1787787111.938654:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1787787111.938673:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787787111.938688:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.938699:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787111.938710:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787787111.938713:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9870d15599b8 from 1 10000000:01000000:0.0:1787787111.938716:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787111.938739:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.938746:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.938755:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787111.938766:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503611008:0@lo:101: 00000100:00100000:0.0:1787787111.938793:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.938806:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.938819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611008 00000100:00100000:0.0:1787787111.938822:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611008 00000100:00100000:0.0:1787787111.938843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787787111.938849:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503611008:12345-0@lo:101: 00010000:00010000:0.0:1787787111.938857:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787111.938869:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8ca8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.938888:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.938905:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.938913:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8ac00, rc 0) 00000100:00100000:0.0:1787787111.938940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503611008:12345-0@lo:101: Request processed in 91us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.938946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787787111.938992:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503611008:0@lo:101: 00010000:00010000:0.0:1787787111.939005:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.939015:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787111.939054:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503611136:0@lo:501: 00000100:00100000:0.0:1787787111.939077:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.939090:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.939102:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611136 00000100:00100000:0.0:1787787111.939105:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611136 00000100:00100000:0.0:1787787111.939125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787787111.939131:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503611136:12345-0@lo:501: 00000100:00100000:0.0:1787787111.939223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503611136:12345-0@lo:501: Request processed in 91us (144us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787111.939230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787787111.939258:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503611136:0@lo:501: 10000000:01000000:0.0:1787787111.939275:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787787111.939285:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787111.939292:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787111.940235:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503610752:0@lo:8: 00000100:00100000:0.0:1787787111.940309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.941451:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503610752 00000100:00100000:1.0:1787787111.941459:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503610752 00000100:00100000:1.0:1787787111.941503:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787111.941510:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503610752:12345-0@lo:8: 00010000:00080000:1.0:1787787111.941542:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1787787111.941570:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a8cb6 00002000:00100000:1.0:1787787111.941584:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff986fc372b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787787111.941588:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787787111.941591:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787787111.941657:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787787111.941681:0:8441:0:(import.c:65:import_set_state_nolock()) ffff986fc372a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787111.941741:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503610752:12345-0@lo:8: Request processed in 229us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.941749:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787787111.941791:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5943840 x1874630503610752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787111.941810:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787111.941818:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787787111.941825:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787111.941830:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787787111.941833:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc388000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787111.941845:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787111.941851:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503610752:0@lo:8: 00000004:00080000:1.0:1787787111.941912:0:9847:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787787111.941957:0:9847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 256123818131ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787787111.941964:0:9847:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:3.0:1787787111.946682:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787787111.946694:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787787111.946864:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc35683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9841:x1874630503609344:12345-0@lo:700: Request processed in 48622us (48737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.946877:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787787111.946960:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3568f00 x1874630503609344/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.946976:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503609344:0@lo:700: 00000004:00080000:0.0:1787787111.950710:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787787111.952436:0:9848:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787787111.952469:0:9848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503611392:0@lo:7: 00000100:00100000:1.0:1787787111.952534:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.952570:0:9848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.952585:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503611264:0@lo:13: 00000100:00100000:1.0:1787787111.952607:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.952682:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611264 00000100:00100000:3.0:1787787111.952691:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611264 00000100:00100000:3.0:1787787111.952759:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787111.952769:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503611264:12345-0@lo:13: 00002000:00000024:3.0:1787787111.952797:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787787111.952849:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503611264:12345-0@lo:13: Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.952856:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787787111.952910:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3043c0 x1874630503611264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.952930:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503611264:0@lo:13: 00000100:00080000:1.0:1787787111.953815:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787111.953948:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611392 00000100:00100000:3.0:1787787111.953955:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611392 00000100:00100000:3.0:1787787111.954005:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787111.954013:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9848:x1874630503611392:12345-0@lo:7: 00000100:00100000:0.0:1787787111.965330:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503611520:0@lo:13: 00000100:00100000:0.0:1787787111.965397:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787787111.965566:0:9841:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787787111.965590:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503611648:0@lo:7: 00000100:00100000:0.0:1787787111.965617:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.965635:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.965707:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611648 00000100:00100000:1.0:1787787111.965714:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611648 00000100:00100000:1.0:1787787111.965766:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787111.965777:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9841:x1874630503611648:12345-0@lo:7: 00000100:00100000:0.0:1787787111.969292:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611520 00000100:00100000:0.0:1787787111.969305:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611520 00000100:00100000:0.0:1787787111.969368:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787111.969381:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503611520:12345-0@lo:13: 00002000:00000024:0.0:1787787111.969406:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787787111.969673:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503611520:12345-0@lo:13: Request processed in 295us (4274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787111.969683:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787787111.969768:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8780 x1874630503611520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787111.969804:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503611520:0@lo:13: 00002000:00080000:3.0:1787787111.971092:0:9030:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787787111.971104:0:9030:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787787111.971210:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9848:x1874630503611392:12345-0@lo:7: Request processed in 17194us (18672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.971221:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787787111.971230:0:9848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5943840 x1874630503611392/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.971263:0:9848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503611392:0@lo:7: 00000004:00080000:0.0:1787787111.971276:0:9848:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787787111.971310:0:9848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503611776:0@lo:5: 00000100:00100000:0.0:1787787111.971344:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.971370:0:9848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.971529:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611776 00000100:00100000:3.0:1787787111.971536:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611776 00000100:00100000:3.0:1787787111.971578:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787111.971589:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9848:x1874630503611776:12345-0@lo:5: 00002000:00080000:3.0:1787787111.971676:0:8444:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787787111.971681:0:8444:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:3.0:1787787111.977603:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787787111.977612:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787787111.977709:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9841:x1874630503611648:12345-0@lo:7: Request processed in 11929us (12086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.977720:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787111.977772:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9848:x1874630503611776:12345-0@lo:5: Request processed in 6183us (6425us total) trans 4294967297 rc 0/0 00010000:00080000:3.0:1787787111.977778:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ea940 x1874630503611648/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.977794:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503611648:0@lo:7: 00000100:00100000:0.0:1787787111.977796:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1787787111.977812:0:9841:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00010000:00080000:0.0:1787787111.977840:0:9848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8000 x1874630503611776/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787111.977852:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503611904:0@lo:5: 00000100:00100000:0.0:1787787111.977856:0:9848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503611776:0@lo:5: 00000004:00080000:0.0:1787787111.977867:0:9848:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787787111.977888:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.977895:0:9848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503612032:0@lo:700: 00000100:00100000:3.0:1787787111.977920:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787111.977927:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787111.977936:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503611904 00000100:00100000:3.0:1787787111.977942:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503611904 00000100:00100000:0.0:1787787111.977945:0:9848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787111.977982:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787111.977991:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9841:x1874630503611904:12345-0@lo:5: 00002000:00080000:3.0:1787787111.978012:0:9030:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787787111.978048:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9841:x1874630503611904:12345-0@lo:5: Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787111.978059:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787787111.978105:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3568f00 x1874630503611904/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.978115:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503611904:0@lo:5: 00000004:00080000:0.0:1787787111.978122:0:9841:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787787111.978156:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503612160:0@lo:5: 00000100:00100000:0.0:1787787111.978178:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.978202:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.978498:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612032 00000100:00100000:1.0:1787787111.978508:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612032 00000100:00100000:1.0:1787787111.978544:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787111.978550:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9848:x1874630503612032:12345-0@lo:700: 00000100:00100000:3.0:1787787111.980228:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612160 00000100:00100000:3.0:1787787111.980241:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612160 00000100:00100000:3.0:1787787111.980282:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787111.980291:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9841:x1874630503612160:12345-0@lo:5: 00002000:00080000:3.0:1787787111.980326:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1787787111.984835:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9841:x1874630503612160:12345-0@lo:5: Request processed in 4538us (6648us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787787111.984848:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00080000:0.0:1787787111.984870:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787787111.985179:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9848:x1874630503612032:12345-0@lo:700: Request processed in 6627us (7251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787111.985200:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787787111.985523:0:9848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ea940 x1874630503612032/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787111.985537:0:9848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787787111.985554:0:9848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503612032:0@lo:700: 00010000:00080000:1.0:1787787111.985701:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5943840 x1874630503612160/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787111.985713:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874630503612160:0@lo:5: 00000004:00080000:1.0:1787787111.985723:0:9841:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787787111.985762:0:9841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9841:1874630503612288:0@lo:900: 00000100:00100000:1.0:1787787111.985823:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787111.985858:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612288 00000100:00100000:1.0:1787787111.985864:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612288 00000100:00100000:1.0:1787787111.985903:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787111.985912:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9841:x1874630503612288:12345-0@lo:900: 00000100:00100000:1.0:1787787111.985953:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9841:x1874630503612288:12345-0@lo:900: Request processed in 42us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787111.985959:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787111.985977:0:9841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0b40 going to sleep for 11 seconds 00010000:00080000:1.0:1787787111.985988:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f7ad00 x1874630503612288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787111.985998:0:9841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9841:1874630503612288:0@lo:900: 00000004:02000040:1.0:1787787111.988357:0:9848:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1787787111.996667:0:9848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503612416:0@lo:5: 00000100:00100000:0.0:1787787111.996737:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787111.996797:0:9848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787111.996982:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612416 00000100:00100000:1.0:1787787111.996990:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612416 00000100:00100000:1.0:1787787111.997046:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787111.997055:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9848:x1874630503612416:12345-0@lo:5: 00002000:00080000:0.0:1787787112.005853:0:8443:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787787112.005876:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1787787112.011985:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9848:x1874630503612416:12345-0@lo:5: Request processed in 14924us (15241us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787787112.011998:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787787112.012052:0:9848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e63480 x1874630503612416/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787112.012069:0:9848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1874630503612416:0@lo:5: 00000004:00080000:0.0:1787787112.012488:0:9848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1787787112.240222:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787112.297339:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787112.297366:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503612544:0@lo:41: 00000100:00100000:3.0:1787787112.297566:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787112.297966:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612544 00000100:00100000:0.0:1787787112.297974:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612544 00000100:00100000:0.0:1787787112.298026:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787112.298037:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503612544:12345-0@lo:41: 00000004:00000024:0.0:1787787112.298082:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787787112.298157:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503612544:12345-0@lo:41: Request processed in 123us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787112.298164:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787112.298675:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503612544:0@lo:41: 00000001:02000400:1.0:1787787112.490285:0:9890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787787113.264883:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787113.534773:0:9943:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787113.535014:0:9943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787114.281877:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787787114.378836:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1787787114.378855:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787787114.857977:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787114.858010:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503612672:0@lo:13: 00000100:00100000:0.0:1787787114.858100:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787114.859367:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503612800:0@lo:13: 00000100:00100000:0.0:1787787114.859410:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787114.868353:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612672 00000100:00100000:2.0:1787787114.868370:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612672 00000100:00100000:2.0:1787787114.868434:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612800 00000100:00100000:2.0:1787787114.868438:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612800 00000100:00100000:2.0:1787787114.868462:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787114.868472:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503612672:12345-0@lo:13: 00002000:00000024:2.0:1787787114.868505:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787114.868601:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503612672:12345-0@lo:13: Request processed in 130us (10501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787114.868609:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787114.868638:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787114.868645:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503612800:12345-0@lo:13: 00002000:00000024:2.0:1787787114.868655:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787787114.869011:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787114.869171:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503612800:12345-0@lo:13: Request processed in 526us (9759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787114.869179:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787787114.872980:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3569680 x1874630503612800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787114.873011:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503612800:0@lo:13: 00010000:00080000:0.0:1787787114.873029:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327e580 x1874630503612672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787114.873042:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503612672:0@lo:13: 00010000:00010000:2.0:1787787115.305571:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787116.187869:0:10044:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787116.188107:0:10044:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787116.331476:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787116.908322:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503612928:0@lo:41: 00000100:00100000:3.0:1787787116.908414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787116.908449:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503612928 00000100:00100000:2.0:1787787116.908457:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503612928 00000100:00100000:2.0:1787787116.908506:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787787116.908516:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503612928:12345-0@lo:41: 00000004:00000024:2.0:1787787116.908550:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787116.913885:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503612928:12345-0@lo:41: Request processed in 5359us (5459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787116.913902:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787116.914307:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503612928:0@lo:41: 00000020:00000004:2.0:1787787117.088568:0:10092:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787117.088582:0:10092:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787787117.353774:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787117.417651:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503613184:0@lo:400: 00000100:00100000:1.0:1787787117.417727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.417793:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503613696:0@lo:400: 00000100:00100000:1.0:1787787117.417861:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.417883:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503614208:0@lo:400: 00000100:00100000:1.0:1787787117.417905:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.417922:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503614720:0@lo:41: 00000100:00100000:1.0:1787787117.417965:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.417992:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787787117.418010:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503613312:0@lo:400: 00000100:00100000:1.0:1787787117.418033:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.418052:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503613824:0@lo:400: 00000100:00100000:1.0:1787787117.418099:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.418115:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503614336:0@lo:400: 00000100:00100000:1.0:1787787117.418164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787117.418193:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613696 00000100:00100000:1.0:1787787117.418200:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613696 00000100:00100000:1.0:1787787117.418244:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614208 00000100:00100000:1.0:1787787117.418247:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614208 00000100:00100000:1.0:1787787117.418262:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613312 00000100:00100000:1.0:1787787117.418265:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613312 00000100:00100000:1.0:1787787117.418288:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613824 00000100:00100000:1.0:1787787117.418291:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613824 00000100:00100000:1.0:1787787117.418303:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614336 00000100:00100000:1.0:1787787117.418306:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614336 00000100:00100000:1.0:1787787117.418322:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787787117.418331:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503613696:12345-0@lo:400: 00000100:00100000:1.0:1787787117.418382:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503613696:12345-0@lo:400: Request processed in 53us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787117.418390:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787787117.418407:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787787117.418413:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503614208:12345-0@lo:400: 00000100:00100000:1.0:1787787117.418439:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503614208:12345-0@lo:400: Request processed in 27us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787117.418444:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787787117.418455:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787117.418462:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503613312:12345-0@lo:400: 00000100:00100000:1.0:1787787117.418485:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503613312:12345-0@lo:400: Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787117.418491:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787117.418502:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787117.418508:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503613824:12345-0@lo:400: 00000100:00100000:1.0:1787787117.418532:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503613824:12345-0@lo:400: Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787117.418537:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787117.418549:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787117.418554:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503614336:12345-0@lo:400: 00000100:00100000:1.0:1787787117.418580:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503614336:12345-0@lo:400: Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787117.418593:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787117.418614:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614720 00000100:00100000:1.0:1787787117.418617:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614720 00000100:00100000:1.0:1787787117.418639:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787117.418645:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503614720:12345-0@lo:41: 00000004:00000024:1.0:1787787117.418672:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787787117.418721:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503614720:12345-0@lo:41: Request processed in 77us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787117.418727:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787787117.418748:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787117.418751:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787117.418772:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3569a40 x1874630503613312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787117.418784:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503613312:0@lo:400: 00010000:00080000:1.0:1787787117.418794:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3569e00 x1874630503613824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787117.418801:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503613824:0@lo:400: 00010000:00080000:1.0:1787787117.418809:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d9645680 x1874630503614336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787117.418816:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503614336:0@lo:400: 00010000:00080000:1.0:1787787117.418824:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3569680 x1874630503613696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787117.418831:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503613696:0@lo:400: 00010000:00080000:1.0:1787787117.418839:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc39521c0 x1874630503614208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787117.418852:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503614208:0@lo:400: 00000100:00100000:1.0:1787787117.418867:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503614720:0@lo:41: 00000100:00100000:2.0:1787787117.419079:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503613440:0@lo:400: 00000100:00100000:2.0:1787787117.419127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419193:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503613952:0@lo:400: 00000100:00100000:2.0:1787787117.419216:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419232:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503614464:0@lo:400: 00000100:00100000:2.0:1787787117.419257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419275:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787787117.419281:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503613056:0@lo:13: 00000100:00100000:2.0:1787787117.419319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419337:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503613568:0@lo:400: 00000100:00100000:2.0:1787787117.419357:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419372:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503614080:0@lo:400: 00000100:00100000:2.0:1787787117.419390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419405:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503614592:0@lo:400: 00000100:00100000:2.0:1787787117.419424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.419450:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613440 00000100:00100000:2.0:1787787117.419454:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613440 00000100:00100000:2.0:1787787117.419479:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787787117.419485:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503613440:12345-0@lo:400: 00000100:00100000:2.0:1787787117.419523:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503613440:12345-0@lo:400: Request processed in 38us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787117.419530:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787787117.419548:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613056 00000100:00100000:2.0:1787787117.419551:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613056 00000100:00100000:2.0:1787787117.419581:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787117.419586:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503613056:12345-0@lo:13: 00002000:00000024:2.0:1787787117.419615:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787117.419644:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503613056:12345-0@lo:13: Request processed in 58us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787117.419649:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787787117.419664:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787787117.419680:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ede00 x1874630503613056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787117.419688:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787787117.419702:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503613056:0@lo:13: 00000100:00100000:2.0:1787787117.419710:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503613440:0@lo:400: 00000100:00100000:2.0:1787787117.419727:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613568 00000100:00100000:2.0:1787787117.419729:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613568 00000100:00100000:2.0:1787787117.419750:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787787117.419755:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503613568:12345-0@lo:400: 00000100:00100000:2.0:1787787117.419781:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503613568:12345-0@lo:400: Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787117.419787:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787787117.419808:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356b840 x1874630503613568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787117.419815:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503613568:0@lo:400: 00000100:00100000:3.0:1787787117.420097:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613184 00000100:00100000:3.0:1787787117.420102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613184 00000100:00100000:3.0:1787787117.420165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787787117.420172:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503613184:12345-0@lo:400: 00000100:00100000:3.0:1787787117.420209:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503613184:12345-0@lo:400: Request processed in 38us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787117.420224:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787787117.420250:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503613952 00000100:00100000:3.0:1787787117.420253:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503613952 00000100:00100000:3.0:1787787117.420274:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614464 00000100:00100000:3.0:1787787117.420277:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614464 00000100:00100000:3.0:1787787117.420285:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614080 00000100:00100000:3.0:1787787117.420287:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614080 00000100:00100000:3.0:1787787117.420296:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614592 00000100:00100000:3.0:1787787117.420299:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614592 00000100:00100000:3.0:1787787117.420310:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787117.420315:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503613952:12345-0@lo:400: 00000100:00100000:3.0:1787787117.420346:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503613952:12345-0@lo:400: Request processed in 31us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787117.420351:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787117.420361:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787117.420367:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503614464:12345-0@lo:400: 00000100:00100000:3.0:1787787117.420388:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503614464:12345-0@lo:400: Request processed in 22us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787117.420393:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787117.420402:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787117.420406:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503614080:12345-0@lo:400: 00000100:00100000:3.0:1787787117.420428:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503614080:12345-0@lo:400: Request processed in 22us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787117.420433:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787117.420442:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787117.420447:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503614592:12345-0@lo:400: 00000100:00100000:3.0:1787787117.420468:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503614592:12345-0@lo:400: Request processed in 21us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787117.420478:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787787117.420490:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787117.420493:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787117.420510:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3043c0 x1874630503614080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787117.420518:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503614080:0@lo:400: 00010000:00080000:3.0:1787787117.420527:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101edde00 x1874630503614592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787117.420533:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787787117.420541:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503614592:0@lo:400: 00010000:00080000:3.0:1787787117.420561:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3568f00 x1874630503613952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787117.420569:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503613952:0@lo:400: 00010000:00080000:3.0:1787787117.420577:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d9647840 x1874630503614464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787117.420584:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9647840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503614464:0@lo:400: 00000100:00100000:0.0:1787787117.421349:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503614848:0@lo:13: 00000100:00100000:0.0:1787787117.421394:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787117.421801:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503613184:0@lo:400: 00000100:00100000:3.0:1787787117.422263:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614848 00000100:00100000:3.0:1787787117.422271:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614848 00000100:00100000:3.0:1787787117.422321:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787117.422330:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503614848:12345-0@lo:13: 00002000:00000024:3.0:1787787117.422351:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787117.422412:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503614848:12345-0@lo:13: Request processed in 83us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787117.422419:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787787117.422518:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8000 x1874630503614848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787117.422536:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503614848:0@lo:13: 00010000:00010000:1.0:1787787118.377422:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787118.766338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.766556:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689280 00000100:00100000:0.0:1787787118.766570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689280 00000100:00100000:0.0:1787787118.768182:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 181 00000100:00100000:0.0:1787787118.768198:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1874630484689280:12345-192.168.204.31@tcp:250: 00010000:00080000:0.0:1787787118.768234:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aa4bc3ea-8edb-4d48-bc1d-b22586017753@192.168.204.31@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:0.0:1787787118.768273:0:6520:0:(genops.c:1385:class_connect()) connect: client aa4bc3ea-8edb-4d48-bc1d-b22586017753, cookie 0x11620bc3f30a8cbd 00000100:00080000:0.0:1787787118.768484:0:6520:0:(import.c:65:import_set_state_nolock()) ffff986fc38b8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787118.768638:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+5:2390:x1874630484689280:12345-192.168.204.31@tcp:250: Request processed in 440us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.768648:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 181 00000100:00100000:1.0:1787787118.771447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.775127:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689152 00000100:00100000:0.0:1787787118.775163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689152 00000100:00100000:0.0:1787787118.775832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 182 00000100:00100000:0.0:1787787118.775846:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+5:6150:x1874630484689152:12345-192.168.204.31@tcp:101: 00010000:00010000:0.0:1787787118.775864:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787118.775880:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c7f97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.775908:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.776070:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.776082:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a200, rc 0) 00000100:00100000:0.0:1787787118.776199:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+6:6150:x1874630484689152:12345-192.168.204.31@tcp:101: Request processed in 356us (4762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.776206:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 182 00000100:00100000:2.0:1787787118.789103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787118.789581:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689408 00000100:00100000:3.0:1787787118.789596:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689408 00000100:00100000:3.0:1787787118.789707:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 183 00000100:00100000:3.0:1787787118.789719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+6:6150:x1874630484689408:12345-192.168.204.31@tcp:501: 00000100:00100000:3.0:1787787118.789890:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+6:6150:x1874630484689408:12345-192.168.204.31@tcp:501: Request processed in 173us (803us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787118.789900:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 183 00000100:00100000:2.0:1787787118.799286:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.799455:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689536 00000100:00100000:0.0:1787787118.799468:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689536 00000100:00100000:0.0:1787787118.799547:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 184 00000100:00100000:0.0:1787787118.799559:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+6:6150:x1874630484689536:12345-192.168.204.31@tcp:101: 00010000:00010000:0.0:1787787118.799583:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787118.799606:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c7f9e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.799645:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.799685:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.799696:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8bc00, rc 0) 00000100:00100000:0.0:1787787118.799784:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+7:6150:x1874630484689536:12345-192.168.204.31@tcp:101: Request processed in 227us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.799792:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 184 00000100:00100000:1.0:1787787118.807256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787118.807578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689664 00000100:00100000:3.0:1787787118.807591:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689664 00000100:00100000:3.0:1787787118.807671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 185 00000100:00100000:3.0:1787787118.807682:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+7:6150:x1874630484689664:12345-192.168.204.31@tcp:501: 00000100:00100000:3.0:1787787118.807985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6150:x1874630484689664:12345-192.168.204.31@tcp:501: Request processed in 303us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787118.807995:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 185 00000100:00100000:3.0:1787787118.810833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787118.810919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689792 00000100:00100000:2.0:1787787118.810950:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689792 00000100:00100000:2.0:1787787118.811019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 186 00000100:00100000:2.0:1787787118.811030:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6150:x1874630484689792:12345-192.168.204.31@tcp:503: 00000100:00100000:2.0:1787787118.814239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6150:x1874630484689792:12345-192.168.204.31@tcp:503: Request processed in 3189us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787118.814260:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 186 00000100:00100000:0.0:1787787118.816675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787118.817186:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484689920 00000100:00100000:1.0:1787787118.817200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484689920 00000100:00100000:1.0:1787787118.818950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 187 00000100:00100000:1.0:1787787118.818985:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6168:x1874630484689920:12345-192.168.204.31@tcp:502: 00000100:00100000:1.0:1787787118.819245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6168:x1874630484689920:12345-192.168.204.31@tcp:502: Request processed in 273us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787118.819255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 187 00000100:00100000:3.0:1787787118.855894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.858720:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690048 00000100:00100000:0.0:1787787118.858740:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690048 00000100:00100000:0.0:1787787118.858850:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 188 00000100:00100000:0.0:1787787118.858862:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6168:x1874630484690048:12345-192.168.204.31@tcp:502: 00000100:00100000:0.0:1787787118.859136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6168:x1874630484690048:12345-192.168.204.31@tcp:502: Request processed in 273us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.861736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 188 00000100:00100000:2.0:1787787118.865723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787118.865886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690176 00000100:00100000:1.0:1787787118.865900:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690176 00000100:00100000:1.0:1787787118.865987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 189 00000100:00100000:1.0:1787787118.865998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6150:x1874630484690176:12345-192.168.204.31@tcp:101: 00010000:00010000:1.0:1787787118.866021:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787118.866045:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454f600/0x11620bc3f30a8cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c7fcf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787118.866091:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454f600/0x11620bc3f30a8cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fcf expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787118.866104:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454f600/0x11620bc3f30a8cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fcf expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787118.866132:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454f600, rc 0) 00000100:00100000:1.0:1787787118.866246:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6150:x1874630484690176:12345-192.168.204.31@tcp:101: Request processed in 249us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787118.866255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 189 00000100:00100000:1.0:1787787118.870837:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787118.871085:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690304 00000100:00100000:3.0:1787787118.871099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690304 00000100:00100000:3.0:1787787118.871245:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 190 00000100:00100000:3.0:1787787118.871257:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6150:x1874630484690304:12345-192.168.204.31@tcp:256: 20000000:01000000:3.0:1787787118.871291:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787787118.871608:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787787118.871615:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787787118.871618:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787787118.871621:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787787118.871624:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787787118.873889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6150:x1874630484690304:12345-192.168.204.31@tcp:256: Request processed in 2619us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.873914:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 190 00000100:00100000:1.0:1787787118.882511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.882598:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690432 00000100:00100000:0.0:1787787118.882614:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690432 00000100:00100000:0.0:1787787118.882695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 191 00000100:00100000:0.0:1787787118.882709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6150:x1874630484690432:12345-192.168.204.31@tcp:101: 00010000:00010000:0.0:1787787118.882734:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787118.882758:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c7fd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.882896:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.882911:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787118.882922:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b800, rc 0) 00000100:00100000:0.0:1787787118.883781:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6150:x1874630484690432:12345-192.168.204.31@tcp:101: Request processed in 1058us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.883793:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 191 00000100:00100000:1.0:1787787118.889907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.890070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690560 00000100:00100000:0.0:1787787118.890083:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690560 00000100:00100000:0.0:1787787118.890326:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 192 00000100:00100000:0.0:1787787118.890340:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6150:x1874630484690560:12345-192.168.204.31@tcp:501: 00000100:00100000:0.0:1787787118.890557:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6150:x1874630484690560:12345-192.168.204.31@tcp:501: Request processed in 220us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.890566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 192 00000100:00100000:2.0:1787787118.893670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787118.893875:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690688 00000100:00100000:0.0:1787787118.893888:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690688 00000100:00100000:0.0:1787787118.894020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 193 00000100:00100000:0.0:1787787118.894033:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6150:x1874630484690688:12345-192.168.204.31@tcp:503: 00000100:00100000:0.0:1787787118.894277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6150:x1874630484690688:12345-192.168.204.31@tcp:503: Request processed in 246us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.894286:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 193 00000100:00100000:2.0:1787787118.901839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787118.905727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690816 00000100:00100000:1.0:1787787118.905750:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690816 00000100:00100000:1.0:1787787118.906075:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 194 00000100:00100000:1.0:1787787118.906088:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6172:x1874630484690816:12345-192.168.204.31@tcp:502: 00000100:00100000:1.0:1787787118.906350:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6172:x1874630484690816:12345-192.168.204.31@tcp:502: Request processed in 263us (4599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787118.906359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 194 00000100:00100000:0.0:1787787118.908679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787118.914404:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484690944 00000100:00100000:2.0:1787787118.914428:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484690944 00000100:00100000:2.0:1787787118.914887:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:2.0:1787787118.914903:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6172:x1874630484690944:12345-192.168.204.31@tcp:502: 00000100:00100000:2.0:1787787118.915440:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6172:x1874630484690944:12345-192.168.204.31@tcp:502: Request processed in 539us (6774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787118.915454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:3.0:1787787118.920931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787118.921039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787118.922892:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691072 00000100:00100000:1.0:1787787118.922911:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691072 00000100:00100000:2.0:1787787118.923463:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691328 00000100:00100000:2.0:1787787118.923470:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691328 00000100:00100000:2.0:1787787118.923588:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787118.923599:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1874630484691328:12345-192.168.204.31@tcp:38: 00010000:00080000:2.0:1787787118.923643:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1787787118.923712:0:6528:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a8ce0 00000004:00100000:2.0:1787787118.923761:0:6528:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787118.924050:0:6528:0:(import.c:65:import_set_state_nolock()) ffff9870df55a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787118.924189:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484691328:12345-192.168.204.31@tcp:38: Request processed in 589us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787118.924198:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:0.0:1787787118.924818:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1787787118.924828:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1874630484691072:12345-192.168.204.31@tcp:38: 00010000:00080000:0.0:1787787118.924850:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1787787118.924896:0:6527:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a8ce7 00000004:00100000:0.0:1787787118.924916:0:6527:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787787118.925503:0:6527:0:(import.c:65:import_set_state_nolock()) ffff986fc38bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787118.925685:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484691072:12345-192.168.204.31@tcp:38: Request processed in 855us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787118.925694:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00010000:00010000:2.0:1787787119.401484:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787119.932429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787119.932788:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691456 00000100:00100000:1.0:1787787119.932803:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691456 00000100:00100000:1.0:1787787119.932916:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:1.0:1787787119.932930:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:0:x1874630484691456:12345-192.168.204.31@tcp:41: 00000004:00000024:1.0:1787787119.932984:0:7753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1787787119.933166:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787119.933486:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:0:x1874630484691456:12345-192.168.204.31@tcp:41: Request processed in 557us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787119.933496:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:2.0:1787787119.941338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787119.941467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787119.941699:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691200 00000100:00100000:0.0:1787787119.941711:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691200 00000100:00100000:0.0:1787787119.941797:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691584 00000100:00100000:0.0:1787787119.941801:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691584 00000100:00100000:0.0:1787787119.941826:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787119.941837:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:0:x1874630484691200:12345-192.168.204.31@tcp:41: 00000004:00000024:0.0:1787787119.941888:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787787119.941986:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:0:x1874630484691200:12345-192.168.204.31@tcp:41: Request processed in 150us (665us total) trans 0 rc 0/0 00000100:00080000:3.0:1787787119.941989:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787119.941998:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787119.942023:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:0.0:1787787119.942043:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484691584:12345-192.168.204.31@tcp:41: 00000004:00000024:0.0:1787787119.942057:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787787119.942082:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484691584:12345-192.168.204.31@tcp:41: Request processed in 51us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787119.942088:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:0.0:1787787119.950677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787119.950838:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691712 00000100:00100000:2.0:1787787119.950851:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691712 00000100:00100000:2.0:1787787119.950945:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787119.950958:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484691712:12345-192.168.204.31@tcp:40: 00000100:00100000:2.0:1787787119.951102:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484691712:12345-192.168.204.31@tcp:40: Request processed in 146us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787119.951112:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787119.954647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787119.955290:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691840 00000100:00100000:3.0:1787787119.955305:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691840 00000100:00100000:3.0:1787787119.955376:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:3.0:1787787119.955384:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5943840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1874630484691840:12345-192.168.204.31@tcp:8: 00010000:00080000:3.0:1787787119.955420:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1787787119.955451:0:8441:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a8cee 00002000:00100000:3.0:1787787119.955464:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99b164f2-528a-4a42-8406-031dcbc8cfdb/ffff9870fc310000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787787119.955496:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787787119.955687:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787787119.955721:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9870fc314000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787119.955792:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5943840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484691840:12345-192.168.204.31@tcp:8: Request processed in 407us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787119.955800:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:0.0:1787787119.957864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787119.958618:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484691968 00000100:00100000:2.0:1787787119.958630:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484691968 00000100:00100000:2.0:1787787119.958681:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:2.0:1787787119.958687:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1874630484691968:12345-192.168.204.31@tcp:8: 00010000:00080000:2.0:1787787119.958720:0:9030:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1787787119.958750:0:9030:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a8cf5 00002000:00100000:2.0:1787787119.958761:0:9030:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99b164f2-528a-4a42-8406-031dcbc8cfdb/ffff9870f4593000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787119.958777:0:9030:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787119.958938:0:9030:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787119.958979:0:9030:0:(import.c:65:import_set_state_nolock()) ffff9870f4591800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787119.959060:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484691968:12345-192.168.204.31@tcp:8: Request processed in 371us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787119.959069:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787119.974655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787119.974701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787119.974798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692096 00000100:00100000:1.0:1787787119.974822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692096 00000100:00100000:1.0:1787787119.974877:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:1.0:1787787119.974886:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2391:x1874630484692096:12345-192.168.204.31@tcp:400: 00000100:00100000:1.0:1787787119.974960:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2391:x1874630484692096:12345-192.168.204.31@tcp:400: Request processed in 76us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787119.974968:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:0.0:1787787119.977698:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787119.977725:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503614976:0@lo:13: 00000100:00100000:0.0:1787787119.977791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787119.977866:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503614976 00000100:00100000:0.0:1787787119.977874:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503614976 00000100:00100000:0.0:1787787119.977930:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787119.977940:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503614976:12345-0@lo:13: 00002000:00000024:0.0:1787787119.977960:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787119.978004:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503614976:12345-0@lo:13: Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787119.978010:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787787119.978033:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787119.978073:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e4f00 x1874630503614976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787119.978092:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503614976:0@lo:13: 00000100:00100000:2.0:1787787119.978296:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692224 00000100:00100000:2.0:1787787119.978302:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692224 00000100:00100000:2.0:1787787119.978341:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:2.0:1787787119.978350:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484692224:12345-192.168.204.31@tcp:900: 00000100:00100000:2.0:1787787119.978410:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484692224:12345-192.168.204.31@tcp:900: Request processed in 62us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787119.978417:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:1.0:1787787119.980056:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503615104:0@lo:13: 00000100:00100000:1.0:1787787119.980129:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787119.980384:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615104 00000100:00100000:3.0:1787787119.980392:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615104 00000100:00100000:3.0:1787787119.980456:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787119.980475:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503615104:12345-0@lo:13: 00002000:00000024:3.0:1787787119.980496:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787119.980538:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503615104:12345-0@lo:13: Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787119.980545:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787787119.981498:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787119.981538:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101edd2c0 x1874630503615104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787119.981560:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503615104:0@lo:13: 00000100:00100000:0.0:1787787119.988903:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787119.988997:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692352 00000100:00100000:1.0:1787787119.989007:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692352 00000100:00100000:1.0:1787787119.989072:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:1.0:1787787119.989082:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484692352:12345-192.168.204.31@tcp:33: 00000004:00080000:3.0:1787787120.011460:0:6530:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 22068us 00000004:00200000:3.0:1787787120.026939:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787787120.027067:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6150:x1874630484692352:12345-192.168.204.31@tcp:33: Request processed in 37982us (38171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787120.027082:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:0.0:1787787120.310232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787120.310429:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692480 00000100:00100000:2.0:1787787120.310440:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692480 00000100:00100000:2.0:1787787120.310509:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:2.0:1787787120.310520:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6191:x1874630484692480:12345-192.168.204.31@tcp:101: 00010000:00010000:2.0:1787787120.310540:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787120.310609:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1390400/0x11620bc3f30a8cfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8007 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787120.310675:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a8d03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787120.310689:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a8d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787120.310704:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a8d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787120.310753:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787120.310774:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787120.310793:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a8d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787120.310819:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1390400/0x11620bc3f30a8cfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8007 expref: 8 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787120.310842:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a8d03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8007 expref: 7 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787120.310851:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d200) 00010000:00010000:2.0:1787787120.310854:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787120.310857:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391000, rc 0) 00000100:00100000:2.0:1787787120.310922:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:6191:x1874630484692480:12345-192.168.204.31@tcp:101: Request processed in 404us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787120.310929:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00010000:00010000:1.0:1787787120.425516:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787121.449547:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787122.027041:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787122.027071:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503615232:0@lo:41: 00000100:00100000:0.0:1787787122.027179:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787122.027249:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615232 00000100:00100000:3.0:1787787122.027259:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615232 00000100:00100000:3.0:1787787122.027328:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787787122.027337:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503615232:12345-0@lo:41: 00000004:00000024:3.0:1787787122.027371:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787787122.027428:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503615232:12345-0@lo:41: Request processed in 92us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787122.027434:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787787122.028242:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503615232:0@lo:41: 00010000:00010000:1.0:1787787122.473894:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787122.537430:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787122.537463:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503615360:0@lo:13: 00000100:00100000:3.0:1787787122.537573:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787122.537758:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615360 00000100:00100000:0.0:1787787122.537766:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615360 00000100:00100000:0.0:1787787122.537832:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787122.537848:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503615360:12345-0@lo:13: 00002000:00000024:0.0:1787787122.537879:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787122.537928:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503615360:12345-0@lo:13: Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787122.537935:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787787122.537980:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5a40 x1874630503615360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787122.538013:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503615360:0@lo:13: 00000100:00080000:3.0:1787787122.538322:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787122.538462:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503615488:0@lo:41: 00000100:00100000:1.0:1787787122.538501:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787122.538624:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615488 00000100:00100000:0.0:1787787122.538631:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615488 00000100:00100000:0.0:1787787122.538732:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787787122.538746:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503615488:12345-0@lo:41: 00000004:00000024:0.0:1787787122.538775:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787787122.538827:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503615488:12345-0@lo:41: Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787122.538834:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787122.538908:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503615488:0@lo:41: 00000100:00100000:2.0:1787787122.539637:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503615616:0@lo:400: 00000100:00100000:2.0:1787787122.539684:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787122.539723:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503616128:0@lo:400: 00000100:00100000:2.0:1787787122.539750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787122.539775:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503616640:0@lo:400: 00000100:00100000:1.0:1787787122.539806:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616128 00000100:00100000:2.0:1787787122.539812:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787122.539814:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616128 00000100:00100000:2.0:1787787122.539840:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787787122.539848:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503616000:0@lo:400: 00000100:00100000:1.0:1787787122.539870:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616640 00000100:00100000:1.0:1787787122.539875:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616640 00000100:00100000:2.0:1787787122.539876:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787122.539896:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616000 00000100:00100000:1.0:1787787122.539900:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616000 00000100:00100000:2.0:1787787122.539905:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503616512:0@lo:400: 00000100:00100000:1.0:1787787122.539916:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787122.539936:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503616128:12345-0@lo:400: 00000100:00100000:2.0:1787787122.539948:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787122.539974:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616512 00000100:00100000:2.0:1787787122.539979:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616512 00000100:00100000:1.0:1787787122.540005:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503616128:12345-0@lo:400: Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787122.540012:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787787122.540021:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787122.540031:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503616640:12345-0@lo:400: 00000100:00100000:1.0:1787787122.540033:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787122.540044:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503616000:12345-0@lo:400: 00000100:00100000:2.0:1787787122.540081:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503616640:12345-0@lo:400: Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787122.540089:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503616000:12345-0@lo:400: Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.540093:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787122.540103:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787787122.540115:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787787122.540124:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503616512:12345-0@lo:400: 00000100:00080000:1.0:1787787122.540131:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787122.540777:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787122.540800:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503615872:0@lo:400: 00000100:00100000:1.0:1787787122.540836:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787122.540859:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503616384:0@lo:400: 00000100:00100000:1.0:1787787122.540882:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787122.540900:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503616896:0@lo:13: 00000100:00100000:1.0:1787787122.540939:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787122.540959:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787787122.540966:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503615744:0@lo:400: 00000100:00100000:1.0:1787787122.541011:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787122.541018:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503616512:12345-0@lo:400: Request processed in 894us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.541027:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787122.541032:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503616256:0@lo:400: 00000100:00100000:2.0:1787787122.541048:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615872 00000100:00100000:2.0:1787787122.541055:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615872 00000100:00100000:1.0:1787787122.541057:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787122.541079:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615744 00000100:00100000:1.0:1787787122.541083:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503616768:0@lo:400: 00000100:00100000:2.0:1787787122.541084:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615744 00000100:00100000:2.0:1787787122.541105:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787122.541114:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787122.541117:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503615872:12345-0@lo:400: 00000100:00100000:2.0:1787787122.541175:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503615872:12345-0@lo:400: Request processed in 62us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.541181:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787787122.541193:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787122.541201:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503615744:12345-0@lo:400: 00000100:00100000:2.0:1787787122.541230:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503615744:12345-0@lo:400: Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.541237:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787122.541272:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616384 00000100:00100000:2.0:1787787122.541276:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616384 00000100:00100000:2.0:1787787122.541312:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616256 00000100:00100000:2.0:1787787122.541315:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616256 00000100:00100000:2.0:1787787122.541331:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616768 00000100:00100000:2.0:1787787122.541333:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616768 00000100:00100000:2.0:1787787122.541350:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787122.541854:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787122.541866:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503616256:12345-0@lo:400: 00000100:00100000:3.0:1787787122.541909:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503616256:12345-0@lo:400: Request processed in 47us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787122.541915:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787122.541929:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787122.541935:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503616768:12345-0@lo:400: 00000100:00100000:3.0:1787787122.541960:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503616768:12345-0@lo:400: Request processed in 26us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787122.541966:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787122.542782:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503616384:12345-0@lo:400: 00000100:00100000:2.0:1787787122.542861:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503616384:12345-0@lo:400: Request processed in 1503us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.542869:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787787122.542904:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787122.542910:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787122.542953:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503615616 00000100:00100000:2.0:1787787122.542960:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503615616 00000100:00100000:2.0:1787787122.543017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787787122.543026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503615616:12345-0@lo:400: 00000100:00100000:2.0:1787787122.543061:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503615616:12345-0@lo:400: Request processed in 37us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.543068:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787787122.543160:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503616000:0@lo:400: 00000100:00100000:2.0:1787787122.543179:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503616512:0@lo:400: 00000100:00100000:2.0:1787787122.543190:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503615616:0@lo:400: 00010000:00080000:2.0:1787787122.543205:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f4780 x1874630503616128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787122.543216:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503616128:0@lo:400: 00010000:00080000:2.0:1787787122.543227:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f7480 x1874630503616640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787122.543251:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503616640:0@lo:400: 00000100:00100000:1.0:1787787122.543789:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503615744:0@lo:400: 00010000:00080000:1.0:1787787122.543816:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f6940 x1874630503616256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787122.543827:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503616256:0@lo:400: 00010000:00080000:1.0:1787787122.543840:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f7c00 x1874630503616768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787122.543849:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503616768:0@lo:400: 00000100:00100000:1.0:1787787122.543862:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503615872:0@lo:400: 00010000:00080000:1.0:1787787122.543874:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f4000 x1874630503616384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787122.543882:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503616384:0@lo:400: 00000100:00100000:0.0:1787787122.544264:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503616896 00000100:00100000:0.0:1787787122.544270:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503616896 00000100:00100000:0.0:1787787122.544318:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787122.544328:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503616896:12345-0@lo:13: 00002000:00000024:0.0:1787787122.544354:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787122.544430:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503616896:12345-0@lo:13: Request processed in 103us (3489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787122.544437:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787787122.545261:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ec780 x1874630503616896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787122.545284:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503616896:0@lo:13: 00000001:00100000:3.0:1787787122.545493:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000100:00100000:0.0:1787787122.722115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787122.722522:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692608 00000100:00100000:2.0:1787787122.722533:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692608 00000100:00100000:2.0:1787787122.722613:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:2.0:1787787122.722624:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:6243:x1874630484692608:12345-192.168.204.31@tcp:41: 00000004:00000024:2.0:1787787122.722656:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787787122.722734:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:6243:x1874630484692608:12345-192.168.204.31@tcp:41: Request processed in 111us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.722742:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00080000:1.0:1787787122.724564:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787122.731704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787122.732594:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692736 00000100:00100000:2.0:1787787122.732606:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692736 00000100:00100000:2.0:1787787122.732701:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:2.0:1787787122.732712:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6243:x1874630484692736:12345-192.168.204.31@tcp:41: 00000004:00000024:2.0:1787787122.732755:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787122.732835:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6243:x1874630484692736:12345-192.168.204.31@tcp:41: Request processed in 125us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.732842:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787122.737003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787122.737300:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692864 00000100:00100000:0.0:1787787122.737310:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692864 00000100:00100000:0.0:1787787122.737392:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:0.0:1787787122.737402:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6243:x1874630484692864:12345-192.168.204.31@tcp:13: 00002000:00000024:0.0:1787787122.737438:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787122.737518:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:6243:x1874630484692864:12345-192.168.204.31@tcp:13: Request processed in 117us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787122.737526:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00080000:1.0:1787787122.738522:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787122.738531:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787122.745562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787122.745800:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484692992 00000100:00100000:2.0:1787787122.745811:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484692992 00000100:00100000:2.0:1787787122.745894:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:2.0:1787787122.745905:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:6243:x1874630484692992:12345-192.168.204.31@tcp:13: 00002000:00000024:2.0:1787787122.745933:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787122.746006:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:6243:x1874630484692992:12345-192.168.204.31@tcp:13: Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787122.746014:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00080000:1.0:1787787122.746114:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787787123.497303:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787124.522311:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787787124.587034:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000001:00100000:1.0:1787787124.588476:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000100:00100000:2.0:1787787125.097384:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503617024:0@lo:13: 00000100:00100000:1.0:1787787125.097387:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503617152:0@lo:13: 00000100:00100000:1.0:1787787125.104195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787125.104354:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617152 00000100:00100000:0.0:1787787125.104363:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617152 00000100:00100000:0.0:1787787125.104433:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787787125.104444:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503617152:12345-0@lo:13: 00002000:00000024:0.0:1787787125.104477:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787125.104755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787125.105200:0:8446:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787787125.105209:0:8446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787787125.105496:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617024 00000100:00100000:2.0:1787787125.105508:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617024 00000100:00100000:1.0:1787787125.105766:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787125.105776:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503617024:12345-0@lo:13: 00002000:00000024:1.0:1787787125.105816:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787125.105891:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503617024:12345-0@lo:13: Request processed in 115us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787125.105898:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787787125.106324:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787125.106366:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e4000 x1874630503617024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787125.106412:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503617152:12345-0@lo:13: Request processed in 1970us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787125.106419:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503617024:0@lo:13: 00000100:00100000:0.0:1787787125.106419:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787787125.106586:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101edc3c0 x1874630503617152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787125.106665:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503617152:0@lo:13: 00000100:00100000:3.0:1787787125.438205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787125.438308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787125.438348:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787125.438403:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693248 00000100:00100000:2.0:1787787125.438414:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693248 00000100:00100000:2.0:1787787125.438480:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693376 00000100:00100000:2.0:1787787125.438484:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693376 00000100:00100000:2.0:1787787125.438512:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:2.0:1787787125.438523:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484693248:12345-192.168.204.31@tcp:400: 00000100:00100000:2.0:1787787125.438684:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484693248:12345-192.168.204.31@tcp:400: Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787125.438693:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:2.0:1787787125.438712:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:2.0:1787787125.438719:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484693376:12345-192.168.204.31@tcp:400: 00000100:00100000:2.0:1787787125.438747:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484693376:12345-192.168.204.31@tcp:400: Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787125.438753:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00080000:2.0:1787787125.438790:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787125.438794:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787125.438908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787125.438973:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693504 00000100:00100000:2.0:1787787125.438979:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693504 00000100:00100000:3.0:1787787125.439014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787125.439032:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:2.0:1787787125.439115:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484693504:12345-192.168.204.31@tcp:400: 00000100:00100000:2.0:1787787125.439235:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484693504:12345-192.168.204.31@tcp:400: Request processed in 123us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787125.439260:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:2.0:1787787125.439272:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693632 00000100:00100000:2.0:1787787125.439275:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693632 00000100:00100000:2.0:1787787125.439299:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:2.0:1787787125.439305:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484693632:12345-192.168.204.31@tcp:400: 00000100:00100000:2.0:1787787125.439331:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484693632:12345-192.168.204.31@tcp:400: Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787125.439336:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00080000:2.0:1787787125.439355:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787125.439357:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787125.439709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693120 00000100:00100000:0.0:1787787125.439716:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693120 00000100:00100000:0.0:1787787125.439756:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00100000:0.0:1787787125.439764:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484693120:12345-192.168.204.31@tcp:400: 00000100:00100000:0.0:1787787125.439797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484693120:12345-192.168.204.31@tcp:400: Request processed in 34us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787125.440058:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 198 00010000:00010000:0.0:1787787125.551988:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787125.614431:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000001:02000400:1.0:1787787126.004058:0:10191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787787126.570322:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787127.145511:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503617280:0@lo:41: 00000100:00100000:2.0:1787787127.145587:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787127.145757:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617280 00000100:00100000:0.0:1787787127.145766:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617280 00000100:00100000:0.0:1787787127.145811:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787787127.145833:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503617280:12345-0@lo:41: 00000004:00000024:0.0:1787787127.145869:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787127.145929:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503617280:12345-0@lo:41: Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787127.145936:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787127.146003:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503617280:0@lo:41: 00010000:00010000:1.0:1787787127.597593:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787127.657490:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787127.657530:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503617536:0@lo:13: 00000100:00100000:3.0:1787787127.657662:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503617408:0@lo:13: 00000100:00100000:3.0:1787787127.657717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787127.657850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787127.657907:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617408 00000100:00100000:1.0:1787787127.657917:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617408 00000100:00100000:1.0:1787787127.657993:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617536 00000100:00100000:1.0:1787787127.657997:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617536 00000100:00100000:1.0:1787787127.658018:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787127.658027:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503617408:12345-0@lo:13: 00002000:00000024:1.0:1787787127.658065:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787127.658123:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503617408:12345-0@lo:13: Request processed in 96us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787127.658131:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787127.658190:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787127.658197:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503617536:12345-0@lo:13: 00002000:00000024:1.0:1787787127.658208:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787127.658250:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503617536:12345-0@lo:13: Request processed in 54us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787127.658256:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787787127.658294:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc39521c0 x1874630503617536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787127.658317:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc39521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503617536:0@lo:13: 00000100:00080000:2.0:1787787127.661135:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787127.661678:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503618048:0@lo:400: 00000100:00100000:2.0:1787787127.661739:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503617664:0@lo:400: 00000100:00100000:2.0:1787787127.661829:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.661936:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503618176:0@lo:400: 00000100:00100000:2.0:1787787127.661970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.661991:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503618688:0@lo:400: 00000100:00100000:2.0:1787787127.662014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662057:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503617792:0@lo:400: 00000100:00100000:3.0:1787787127.662066:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503617920:0@lo:400: 00000100:00100000:2.0:1787787127.662086:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662110:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503618304:0@lo:400: 00000100:00100000:3.0:1787787127.662118:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662161:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662194:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503618816:0@lo:400: 00000100:00100000:2.0:1787787127.662220:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662255:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617664 00000100:00100000:2.0:1787787127.662264:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617664 00000100:00100000:2.0:1787787127.662322:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787787127.662335:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503617664:12345-0@lo:400: 00000100:00100000:2.0:1787787127.662409:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503617664:12345-0@lo:400: Request processed in 66us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787787127.662467:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618176 00000100:00100000:2.0:1787787127.662471:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618176 00000100:00100000:2.0:1787787127.662503:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618688 00000100:00100000:2.0:1787787127.662507:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618688 00000100:00100000:2.0:1787787127.662522:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617792 00000100:00100000:2.0:1787787127.662525:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617792 00000100:00100000:2.0:1787787127.662537:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618304 00000100:00100000:2.0:1787787127.662539:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618304 00000100:00100000:2.0:1787787127.662553:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618816 00000100:00100000:2.0:1787787127.662555:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618816 00000100:00100000:2.0:1787787127.662571:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787787127.662578:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503618176:12345-0@lo:400: 00000100:00100000:2.0:1787787127.662615:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503618176:12345-0@lo:400: Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662621:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787787127.662636:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787127.662643:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503618688:12345-0@lo:400: 00000100:00100000:2.0:1787787127.662669:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503618688:12345-0@lo:400: Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662676:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787127.662696:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787127.662702:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503617792:12345-0@lo:400: 00000100:00100000:2.0:1787787127.662738:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503617792:12345-0@lo:400: Request processed in 36us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662744:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787127.662756:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787787127.662763:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503618304:12345-0@lo:400: 00000100:00100000:2.0:1787787127.662790:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503618304:12345-0@lo:400: Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662797:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787787127.662811:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787787127.662818:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503618816:12345-0@lo:400: 00000100:00100000:0.0:1787787127.662854:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662859:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503618816:12345-0@lo:400: Request processed in 40us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662867:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787787127.662881:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618048 00000100:00100000:0.0:1787787127.662881:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503618560:0@lo:400: 00000100:00100000:2.0:1787787127.662899:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618048 00000100:00100000:2.0:1787787127.662924:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787127.662931:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787127.662934:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503618048:12345-0@lo:400: 00000100:00100000:2.0:1787787127.662983:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503618048:12345-0@lo:400: Request processed in 52us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787127.662990:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787787127.663047:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503618432:0@lo:400: 00000100:00100000:2.0:1787787127.663174:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503617664:0@lo:400: 00000100:00100000:2.0:1787787127.663193:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503618176:0@lo:400: 00000100:00100000:2.0:1787787127.663205:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503618688:0@lo:400: 00000100:00100000:3.0:1787787127.663264:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503617792:0@lo:400: 00010000:00080000:3.0:1787787127.663280:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7480 x1874630503618304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787127.663292:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503618304:0@lo:400: 00010000:00080000:3.0:1787787127.663313:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a75680 x1874630503618816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787127.663321:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503618816:0@lo:400: 00000100:00080000:3.0:1787787127.663350:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787127.663356:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787127.664086:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503618048:0@lo:400: 00000100:00100000:3.0:1787787127.664238:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618560 00000100:00100000:3.0:1787787127.664245:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618560 00000100:00100000:3.0:1787787127.664297:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787127.664306:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503618560:12345-0@lo:400: 00000100:00100000:3.0:1787787127.664382:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503618560:12345-0@lo:400: Request processed in 76us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787127.664391:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787787127.664414:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787127.666292:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503617920 00000100:00100000:0.0:1787787127.666306:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503617920 00000100:00100000:0.0:1787787127.666382:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787127.666395:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503617920:12345-0@lo:400: 00000100:00100000:0.0:1787787127.666502:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503617920:12345-0@lo:400: Request processed in 110us (4385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787127.666510:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787127.666540:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787127.666588:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503618944:0@lo:41: 00000100:00100000:0.0:1787787127.666631:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787787127.666671:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e61c0 x1874630503617408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787127.666695:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503617408:0@lo:13: 00000100:00100000:0.0:1787787127.666729:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503617920:0@lo:400: 00000100:00100000:2.0:1787787127.666732:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618944 00000100:00100000:2.0:1787787127.666739:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618944 00000100:00100000:2.0:1787787127.666770:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787787127.666771:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5a40 x1874630503618560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787127.666780:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503618944:12345-0@lo:41: 00000100:00100000:0.0:1787787127.666798:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503618560:0@lo:400: 00000004:00000024:2.0:1787787127.666818:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787787127.666826:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503618432 00000100:00100000:0.0:1787787127.666832:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503618432 00000100:00100000:2.0:1787787127.666877:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503618944:12345-0@lo:41: Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787127.666884:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787127.666898:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787787127.666910:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503618432:12345-0@lo:400: 00000100:00100000:0.0:1787787127.666953:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503618432:12345-0@lo:400: Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787127.666959:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787787127.666983:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787127.667001:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e4000 x1874630503618432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787127.667011:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503618432:0@lo:400: 00000100:00100000:0.0:1787787127.667023:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503618944:0@lo:41: 00010000:00010000:1.0:1787787128.619311:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787129.643793:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787787130.128712:0:10339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff27532f70 20000000:00000080:3.0:1787787130.128733:0:10339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9870f592e400 uarg=0000000000000000 20000000:01000000:3.0:1787787130.128792:0:10339:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787787130.128794:0:10339:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787787130.128797:0:10339:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787787130.128802:0:10339:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787787130.128807:0:10339:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787787130.128881:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787787130.128884:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787787130.131716:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1787787130.133686:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1787787130.133728:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1787787130.133763:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1787787130.133778:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787787130.133780:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787787130.135206:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787787130.136671:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1787787130.136706:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1787787130.136721:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1787787130.136733:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787787130.136736:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787787130.139722:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787787130.139959:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787787130.139991:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787787130.140009:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1787787130.140020:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787787130.140022:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787787130.140765:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1787787130.143684:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1787787130.143719:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1787787130.143732:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1787787130.143741:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787787130.143744:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787787130.150235:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787787130.150579:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787787130.150613:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787787130.150650:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1787787130.150666:0:10339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787787130.150685:0:10339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150705:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150714:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150722:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150730:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150737:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150743:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150750:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150757:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150764:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150784:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150804:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150812:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150869:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.150888:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 9 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.150903:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787130.151025:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.151034:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 9 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.151042:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787130.151071:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.151079:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 23 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.151097:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619328:0@lo:104: 00000100:00100000:3.0:1787787130.151907:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787130.152001:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.152012:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 23 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.152022:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619456:0@lo:104: 00000100:00100000:3.0:1787787130.152074:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787130.162101:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.162127:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 23 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.162157:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619584:0@lo:104: 00000100:00100000:3.0:1787787130.162213:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.162326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.162399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.163712:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693760 00000100:00100000:0.0:1787787130.163723:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693760 00010000:00010000:0.0:1787787130.163765:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 10 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.163816:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484693888 00000100:00100000:0.0:1787787130.163820:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484693888 00010000:00010000:0.0:1787787130.163833:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 11 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.163860:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:0.0:1787787130.163868:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3643450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:2392:x1874630484693760:12345-192.168.204.31@tcp:103: 00010000:00010000:0.0:1787787130.163882:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.163888:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 11 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.163901:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 11 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.163923:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.163979:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3643450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:2392:x1874630484693760:12345-192.168.204.31@tcp:103: Request processed in 111us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.163987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:0.0:1787787130.164034:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:0.0:1787787130.164041:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2394:x1874630484693888:12345-192.168.204.31@tcp:103: 00010000:00010000:0.0:1787787130.164049:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.164053:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 10 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.164063:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 10 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.164085:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.164106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2394:x1874630484693888:12345-192.168.204.31@tcp:103: Request processed in 66us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.164113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787130.166820:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503619328 00000100:00100000:1.0:1787787130.166834:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503619328 00000100:00100000:1.0:1787787130.166899:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503619456 00000100:00100000:1.0:1787787130.166902:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503619456 00000100:00100000:1.0:1787787130.166919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787130.166929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:10339:x1874630503619328:12345-0@lo:104: 00010000:00010000:1.0:1787787130.166947:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.167096:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787130.167103:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:10339:x1874630503619328:12345-0@lo:104: Request processed in 175us (15964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.167118:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787130.167135:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787130.167158:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:10339:x1874630503619456:12345-0@lo:104: 00010000:00010000:1.0:1787787130.167167:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.167877:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787130.167887:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.167895:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8ae00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787130.167899:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.167907:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787130.167915:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787130.167920:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787130.167959:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.167966:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787130.167986:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.167993:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8ca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8caf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168026:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787130.168030:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168036:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787130.168039:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168045:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787130.168052:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787130.168057:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787130.168207:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168214:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787130.168220:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168226:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8c85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168236:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.168237:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.168239:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787130.168267:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503619712:0@lo:103: 00000100:00100000:0.0:1787787130.168320:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.168361:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787130.168368:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503619840:0@lo:103: 00000100:00100000:0.0:1787787130.168388:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.168586:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503619712 00000100:00100000:0.0:1787787130.168592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503619712 00010000:00010000:0.0:1787787130.168618:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 24 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.168636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503619840 00000100:00100000:0.0:1787787130.168639:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503619840 00010000:00010000:0.0:1787787130.168649:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 25 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.168660:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787130.168667:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+25:3653:x1874630503619712:12345-0@lo:103: 00010000:00010000:0.0:1787787130.168677:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.168681:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 25 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168691:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 25 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168709:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.168737:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+25:3653:x1874630503619712:12345-0@lo:103: Request processed in 70us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.168743:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787130.168757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787130.168763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503619840:12345-0@lo:103: 00010000:00010000:0.0:1787787130.168778:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.168782:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 24 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168791:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 24 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.168800:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.168822:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503619840:12345-0@lo:103: Request processed in 59us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.168828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787130.168880:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503619840:0@lo:103: 00000100:00100000:0.0:1787787130.168887:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503619712:0@lo:103: 00010000:00010000:1.0:1787787130.169894:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787787130.169910:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:10339:x1874630503619456:12345-0@lo:104: Request processed in 2750us (17833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.169935:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787787130.170019:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787130.170332:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.170346:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 23 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170358:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619968:0@lo:104: 00000100:00100000:3.0:1787787130.170412:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787130.170561:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.170582:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 23 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170592:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620096:0@lo:104: 00010000:00010000:3.0:1787787130.170620:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.170628:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 23 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170636:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620224:0@lo:104: 00010000:00010000:3.0:1787787130.170662:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.170670:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 23 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170677:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620352:0@lo:104: 00010000:00010000:3.0:1787787130.170700:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.170708:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 23 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170715:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620480:0@lo:104: 00010000:00010000:3.0:1787787130.170736:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787130.170756:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 23 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170765:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620608:0@lo:104: 00000100:00100000:3.0:1787787130.170787:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade480 going to sleep for 11 seconds 00010000:00010000:3.0:1787787130.170809:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8ccb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f9e expref: 9 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170822:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787130.170832:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8a200/0x11620bc3f30a8cc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7f97 expref: 8 pid: 6519 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170860:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787130.170872:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8caf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8ca8 expref: 23 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170880:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619328:0@lo:104: 00010000:00010000:3.0:1787787130.170889:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8b200/0x11620bc3f30a8c8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8c85 expref: 22 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.170896:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619456:0@lo:104: 00000100:00100000:0.0:1787787130.172847:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787787130.172896:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.172923:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.172932:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.172941:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.172951:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.172962:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503619584 00000100:00100000:0.0:1787787130.172971:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503619584 00000100:00100000:0.0:1787787130.173015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503619968 00000100:00100000:0.0:1787787130.173019:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503619968 00000100:00100000:0.0:1787787130.173031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620096 00000100:00100000:0.0:1787787130.173033:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620096 00000100:00100000:0.0:1787787130.173043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620224 00000100:00100000:0.0:1787787130.173045:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620224 00000100:00100000:0.0:1787787130.173053:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620352 00000100:00100000:0.0:1787787130.173055:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620352 00000100:00100000:0.0:1787787130.173095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620480 00000100:00100000:0.0:1787787130.173098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620480 00000100:00100000:0.0:1787787130.173106:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620608 00000100:00100000:0.0:1787787130.173118:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620608 00000100:00100000:0.0:1787787130.173162:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787130.173172:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+9:10339:x1874630503619584:12345-0@lo:104: 00010000:00010000:0.0:1787787130.173189:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.173267:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787130.173273:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+9:10339:x1874630503619584:12345-0@lo:104: Request processed in 103us (11060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.173280:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787130.173297:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787130.173303:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc303050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+8:10339:x1874630503619968:12345-0@lo:104: 00010000:00010000:0.0:1787787130.173312:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.173346:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787130.173351:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc303050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+8:10339:x1874630503619968:12345-0@lo:104: Request processed in 50us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.173356:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787130.173389:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787130.173396:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+7:10339:x1874630503620096:12345-0@lo:104: 00010000:00010000:0.0:1787787130.173404:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.173430:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787787130.173441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+7:10339:x1874630503620096:12345-0@lo:104: Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.173448:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787130.173460:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787130.173466:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+6:10339:x1874630503620224:12345-0@lo:104: 00010000:00010000:0.0:1787787130.173474:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173615:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787787130.173622:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173629:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787130.173633:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173642:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787130.173649:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787130.173655:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787130.173692:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173699:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787130.173719:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173727:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8c69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c70 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173738:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787130.173742:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173759:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787130.173762:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173769:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787130.173775:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787130.173779:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787130.173795:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173800:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787130.173805:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173812:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30a8c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173821:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787130.173824:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173829:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1390c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787130.173831:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173860:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787130.173866:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787130.173871:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787130.173884:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173889:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787130.173904:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173911:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c1390c00/0x11620bc3f30a8c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c2a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.173923:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787130.173924:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787130.173926:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787130.173941:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503620736:0@lo:103: 00000100:00100000:1.0:1787787130.173979:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787130.174013:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787130.174019:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503620864:0@lo:103: 00000100:00100000:1.0:1787787130.174038:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787130.174174:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787130.174181:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+6:10339:x1874630503620224:12345-0@lo:104: Request processed in 715us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.174188:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787130.174204:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787130.174211:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+5:10339:x1874630503620352:12345-0@lo:104: 00010000:00010000:0.0:1787787130.174220:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174248:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787130.174252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+5:10339:x1874630503620352:12345-0@lo:104: Request processed in 44us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.174257:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787130.174268:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787130.174274:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:10339:x1874630503620480:12345-0@lo:104: 00010000:00010000:0.0:1787787130.174281:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174304:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787787130.174315:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:10339:x1874630503620480:12345-0@lo:104: Request processed in 41us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.174321:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787130.174333:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787130.174338:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:10339:x1874630503620608:12345-0@lo:104: 00010000:00010000:0.0:1787787130.174346:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174370:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787787130.174375:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:10339:x1874630503620608:12345-0@lo:104: Request processed in 38us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.174380:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787130.174702:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619584:0@lo:104: 00000100:00100000:3.0:1787787130.174714:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503619968:0@lo:104: 00000100:00100000:3.0:1787787130.174721:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620096:0@lo:104: 00000100:00100000:3.0:1787787130.174729:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620224:0@lo:104: 00000100:00100000:3.0:1787787130.174749:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620352:0@lo:104: 00000100:00100000:3.0:1787787130.174756:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620480:0@lo:104: 00000100:00100000:3.0:1787787130.174763:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1874630503620608:0@lo:104: 00010000:00010000:3.0:1787787130.174802:0:10339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174856:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787787130.174862:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174869:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787130.174872:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174880:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787130.174888:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787130.174893:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787130.174912:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174928:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787130.174938:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174945:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c1c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174957:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787787130.174959:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174965:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787130.174967:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.174973:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787130.174979:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787130.174984:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787130.174995:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175000:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787130.175019:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175026:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30a8c07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8c0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175041:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787130.175044:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175049:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787130.175052:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175059:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787130.175065:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787130.175070:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787130.175082:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175087:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787130.175092:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175098:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c1391c00/0x11620bc3f30a8bc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8bcf expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.175208:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787787130.175286:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503621248:0@lo:103: 00000100:00100000:3.0:1787787130.175320:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787130.175352:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787130.175358:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503621376:0@lo:103: 00000100:00100000:3.0:1787787130.175380:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787130.175471:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.175473:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.175475:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787130.175496:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503621120:0@lo:103: 00000100:00100000:0.0:1787787130.175603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.175618:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787130.175624:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503620992:0@lo:103: 00000100:00100000:0.0:1787787130.175643:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.175669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620736 00000100:00100000:0.0:1787787130.175677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620736 00010000:00010000:0.0:1787787130.175708:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 22 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.175729:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620864 00000100:00100000:0.0:1787787130.175732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620864 00010000:00010000:0.0:1787787130.175742:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 23 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.175752:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621248 00000100:00100000:0.0:1787787130.175755:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621248 00010000:00010000:0.0:1787787130.175763:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 24 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.175771:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621376 00000100:00100000:0.0:1787787130.175773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621376 00010000:00010000:0.0:1787787130.175781:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 25 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.175789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621120 00000100:00100000:0.0:1787787130.175791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621120 00010000:00010000:0.0:1787787130.175798:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 26 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.175806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503620992 00000100:00100000:0.0:1787787130.175807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503620992 00010000:00010000:0.0:1787787130.175814:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 27 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.175835:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787130.175854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+27:3655:x1874630503620736:12345-0@lo:103: 00010000:00010000:0.0:1787787130.175866:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.175871:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 27 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175882:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 27 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175898:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8c70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8c69 expref: 27 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.175910:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.175994:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+26:3655:x1874630503620736:12345-0@lo:103: Request processed in 140us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.176001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787130.176016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787130.176021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+25:3655:x1874630503620864:12345-0@lo:103: 00010000:00010000:0.0:1787787130.176029:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.176032:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 25 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.176040:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 25 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.176050:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15600/0x11620bc3f30a8c46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8c3f expref: 25 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.176072:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.176095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503620864:12345-0@lo:103: Request processed in 74us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.176100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787130.176228:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787130.176237:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503621248:12345-0@lo:103: 00010000:00010000:1.0:1787787130.176254:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787130.176262:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 24 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176271:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 24 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176280:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8c07 expref: 24 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176289:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787130.176314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+23:3655:x1874630503621248:12345-0@lo:103: Request processed in 79us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.176320:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787130.176332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787130.176337:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3640050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+22:3655:x1874630503621376:12345-0@lo:103: 00010000:00010000:1.0:1787787130.176343:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787130.176347:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 22 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176355:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 22 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176364:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a8bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8bc8 expref: 22 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176371:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787130.176389:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3640050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+21:3655:x1874630503621376:12345-0@lo:103: Request processed in 51us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.176393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787130.176411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787130.176416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+20:3654:x1874630503621120:12345-0@lo:103: 00010000:00010000:1.0:1787787130.176423:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787130.176427:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 20 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176435:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 20 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176445:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391600/0x11620bc3f30a8c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8c15 expref: 20 pid: 6522 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176453:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787130.176481:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+19:3654:x1874630503621120:12345-0@lo:103: Request processed in 66us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.176487:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787130.176498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787787130.176516:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+18:3654:x1874630503620992:12345-0@lo:103: 00010000:00010000:1.0:1787787130.176523:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787130.176527:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 18 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176535:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 18 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176544:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14800/0x11620bc3f30a8c2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8c23 expref: 18 pid: 6520 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.176553:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787130.176573:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+17:3654:x1874630503620992:12345-0@lo:103: Request processed in 70us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.176586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787130.176750:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503620992:0@lo:103: 00000100:00100000:0.0:1787787130.176761:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503621120:0@lo:103: 00010000:00010000:1.0:1787787130.178869:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787130.178875:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787130.178877:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.178978:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.178991:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454ee00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787130.178996:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179006:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787130.179013:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787130.179019:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787130.179079:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179085:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787130.179114:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179121:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8ba5 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179173:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.179175:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787130.179177:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787130.179184:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787130.179201:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503621504:0@lo:103: 00000100:00100000:0.0:1787787130.179262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.179310:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621504 00000100:00100000:0.0:1787787130.179317:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621504 00010000:00010000:0.0:1787787130.179341:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 16 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787130.179368:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787130.179376:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+16:3654:x1874630503621504:12345-0@lo:103: 00010000:00010000:0.0:1787787130.179387:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787130.179406:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 16 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179418:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 16 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179432:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14200/0x11620bc3f30a8ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8b9e expref: 16 pid: 6519 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179446:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179454:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179479:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179487:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179493:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179499:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179769:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787130.179773:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179780:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179803:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.179812:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787130.179862:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+15:3654:x1874630503621504:12345-0@lo:103: Request processed in 487us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.179869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787130.179907:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503621504:0@lo:103: 00010000:00010000:1.0:1787787130.181150:0:10339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.181164:0:10339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787130.181171:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8d0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787130.186053:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503620736:0@lo:103: 00000100:00100000:3.0:1787787130.186100:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503621376:0@lo:103: 00000100:00100000:3.0:1787787130.186120:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503621248:0@lo:103: 00000100:00100000:3.0:1787787130.186129:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503620864:0@lo:103: 00000100:00100000:3.0:1787787130.217351:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787130.217377:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503621632:0@lo:13: 00000100:00100000:3.0:1787787130.217446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787130.217529:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621632 00000100:00100000:3.0:1787787130.217536:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621632 00000100:00100000:3.0:1787787130.217591:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787130.217600:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503621632:12345-0@lo:13: 00002000:00000024:3.0:1787787130.217629:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787130.217674:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503621632:12345-0@lo:13: Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787130.217694:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787787130.217717:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787130.217747:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403cb40 x1874630503621632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787130.217767:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503621632:0@lo:13: 00000100:00100000:1.0:1787787130.218410:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787130.218424:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503621760:0@lo:13: 00000100:00100000:1.0:1787787130.218462:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787130.218590:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621760 00000100:00100000:0.0:1787787130.218596:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621760 00000100:00100000:0.0:1787787130.218652:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787130.218661:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503621760:12345-0@lo:13: 00002000:00000024:0.0:1787787130.218674:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787130.218716:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503621760:12345-0@lo:13: Request processed in 57us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.218723:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787787130.218753:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101edf840 x1874630503621760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787130.218767:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503621760:0@lo:13: 00000100:00080000:1.0:1787787130.218812:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787130.542629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.542719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.542751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787130.542812:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694400 00000100:00100000:3.0:1787787130.542822:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694400 00000100:00100000:3.0:1787787130.542920:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:3.0:1787787130.542933:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484694400:12345-192.168.204.31@tcp:400: 00000100:00100000:3.0:1787787130.543022:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484694400:12345-192.168.204.31@tcp:400: Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787130.543029:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00080000:1.0:1787787130.543583:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787130.544034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787130.544254:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694272 00000100:00100000:1.0:1787787130.544261:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694272 00000100:00100000:1.0:1787787130.544320:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787130.544329:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484694272:12345-192.168.204.31@tcp:400: 00000100:00100000:1.0:1787787130.544383:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484694272:12345-192.168.204.31@tcp:400: Request processed in 55us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.544390:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00080000:0.0:1787787130.544946:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787130.545484:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694144 00000100:00100000:2.0:1787787130.545490:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694144 00000100:00100000:2.0:1787787130.545628:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694016 00000100:00100000:2.0:1787787130.545631:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694016 00000100:00100000:1.0:1787787130.545678:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:1.0:1787787130.545688:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484694144:12345-192.168.204.31@tcp:400: 00000100:00100000:1.0:1787787130.545755:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484694144:12345-192.168.204.31@tcp:400: Request processed in 68us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787130.545782:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00080000:0.0:1787787130.547056:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787130.547064:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787130.547264:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:2.0:1787787130.547275:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484694016:12345-192.168.204.31@tcp:400: 00000100:00100000:2.0:1787787130.547343:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484694016:12345-192.168.204.31@tcp:400: Request processed in 71us (4591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787130.547350:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00010000:00010000:0.0:1787787130.667580:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787130.861765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.861873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694528 00000100:00100000:0.0:1787787130.861884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694528 00000100:00100000:0.0:1787787130.861949:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 200 00000100:00100000:0.0:1787787130.861968:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:6164:x1874630484694528:12345-192.168.204.31@tcp:101: 00010000:00010000:0.0:1787787130.861986:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787130.862006:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8a400/0x11620bc3f30a8d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c800e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.862036:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8a400/0x11620bc3f30a8d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c800e expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.862089:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8a400/0x11620bc3f30a8d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c800e expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787130.862099:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a400, rc 0) 00000100:00100000:0.0:1787787130.862194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484694528:12345-192.168.204.31@tcp:101: Request processed in 237us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.862202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 200 00000100:00100000:3.0:1787787130.870413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787130.870517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694656 00000100:00100000:2.0:1787787130.870527:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694656 00000100:00100000:2.0:1787787130.870586:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 201 00000100:00100000:2.0:1787787130.870596:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484694656:12345-192.168.204.31@tcp:501: 00000100:00100000:2.0:1787787130.870771:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484694656:12345-192.168.204.31@tcp:501: Request processed in 175us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787130.870779:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 201 00000100:00100000:1.0:1787787130.899425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787130.899603:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694784 00000100:00100000:2.0:1787787130.899613:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694784 00000100:00100000:2.0:1787787130.899690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:2.0:1787787130.899700:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484694784:12345-192.168.204.31@tcp:503: 00000100:00100000:2.0:1787787130.899874:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484694784:12345-192.168.204.31@tcp:503: Request processed in 175us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787130.899890:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:1.0:1787787130.906653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.911382:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484694912 00000100:00100000:0.0:1787787130.911410:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484694912 00000100:00100000:0.0:1787787130.911491:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 203 00000100:00100000:0.0:1787787130.911502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6638:x1874630484694912:12345-192.168.204.31@tcp:502: 00000100:00100000:0.0:1787787130.911697:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6638:x1874630484694912:12345-192.168.204.31@tcp:502: Request processed in 196us (5052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.911704:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 203 00000100:00100000:3.0:1787787130.930560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.930718:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695040 00000100:00100000:0.0:1787787130.930730:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695040 00000100:00100000:0.0:1787787130.930794:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 204 00000100:00100000:0.0:1787787130.930805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6638:x1874630484695040:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787130.931506:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6638:x1874630484695040:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 699us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787130.931516:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 204 00000100:00100000:1.0:1787787130.946488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787130.946629:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695168 00000100:00100000:2.0:1787787130.946639:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695168 00000100:00100000:2.0:1787787130.946699:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:2.0:1787787130.946709:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484695168:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787130.946726:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787130.946745:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1390600/0x11620bc3f30a8d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8015 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787130.946775:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1390600/0x11620bc3f30a8d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8015 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787130.946787:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1390600/0x11620bc3f30a8d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8015 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787130.946797:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1390600, rc 0) 00000100:00100000:2.0:1787787130.946870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695168:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 162us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787130.946882:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:1.0:1787787130.957522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787130.957679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695296 00000100:00100000:0.0:1787787130.957689:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695296 00000100:00100000:0.0:1787787130.957749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 206 00000100:00100000:0.0:1787787130.957759:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695296:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787130.957911:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695296:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 151us (397us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787130.957919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 206 10000000:01000000:1.0:1787787131.305333:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787787131.305342:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870f5ba1800 from 48 10000000:01000000:1.0:1787787131.305347:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787131.305414:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.305426:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.305438:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.305475:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503621888:0@lo:101: 00000100:00100000:1.0:1787787131.305557:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.305686:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.308729:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503621888 00000100:00100000:0.0:1787787131.308746:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503621888 00000100:00100000:0.0:1787787131.308895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787787131.308906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+15:6524:x1874630503621888:12345-0@lo:101: 00010000:00010000:0.0:1787787131.308925:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787131.308943:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8ba00/0x11620bc3f30a8d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d1f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.309101:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8ba00/0x11620bc3f30a8d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d1f expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.309114:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8ba00/0x11620bc3f30a8d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d1f expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.309123:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8ba00, rc 0) 00000100:00100000:0.0:1787787131.309309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503621888:12345-0@lo:101: Request processed in 404us (3752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.309317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787787131.309435:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503621888:0@lo:101: 00010000:00010000:1.0:1787787131.309455:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.309466:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.309565:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622016:0@lo:501: 00000100:00100000:1.0:1787787131.309601:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.309641:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.309992:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622016 00000100:00100000:2.0:1787787131.309999:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622016 00000100:00100000:2.0:1787787131.310049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787787131.310057:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503622016:12345-0@lo:501: 00000100:00100000:2.0:1787787131.310278:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503622016:12345-0@lo:501: Request processed in 221us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.310287:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787787131.314585:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622016:0@lo:501: 00000100:00100000:1.0:1787787131.315637:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622144:0@lo:503: 00000100:00100000:1.0:1787787131.315736:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.315787:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.315914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622144 00000100:00100000:0.0:1787787131.315922:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622144 00000100:00100000:0.0:1787787131.315981:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787787131.315996:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503622144:12345-0@lo:503: 00000100:00100000:0.0:1787787131.316163:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503622144:12345-0@lo:503: Request processed in 172us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.316182:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787787131.316516:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622144:0@lo:503: 00000100:00100000:2.0:1787787131.318098:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10357:1874630503622272:0@lo:502: 00000100:00100000:2.0:1787787131.318204:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.318249:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c30d2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.320025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622272 00000100:00100000:0.0:1787787131.320038:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622272 00000100:00100000:0.0:1787787131.320106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787787131.320118:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:10357:x1874630503622272:12345-0@lo:502: 00000100:00100000:0.0:1787787131.320473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+16:10357:x1874630503622272:12345-0@lo:502: Request processed in 357us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.320483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787787131.320495:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10357:1874630503622272:0@lo:502: 00000100:00100000:3.0:1787787131.320558:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10357:1874630503622400:0@lo:502: 00000100:00100000:3.0:1787787131.320600:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787131.320693:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.325578:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622400 00000100:00100000:1.0:1787787131.325595:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622400 00000100:00100000:1.0:1787787131.325666:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787787131.325677:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:10357:x1874630503622400:12345-0@lo:502: 00000100:00100000:1.0:1787787131.330605:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+16:10357:x1874630503622400:12345-0@lo:502: Request processed in 4918us (9993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.330621:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787787131.330801:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10357:1874630503622400:0@lo:502: 00000040:00080000:3.0:1787787131.330854:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787787131.331037:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787787131.331060:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787131.331071:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.331083:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787131.331093:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787787131.331095:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787787131.331108:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787787131.331311:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.331321:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.331333:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.331354:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622528:0@lo:101: 00000100:00100000:1.0:1787787131.331410:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.331449:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.332589:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622528 00000100:00100000:2.0:1787787131.332599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622528 00000100:00100000:2.0:1787787131.332662:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787787131.332671:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+16:6524:x1874630503622528:12345-0@lo:101: 00010000:00010000:2.0:1787787131.332686:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787131.332701:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d2d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.332726:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d2d expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.332738:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d2d expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.332748:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391c00, rc 0) 00000100:00100000:2.0:1787787131.332811:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503622528:12345-0@lo:101: Request processed in 141us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.332830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787787131.333251:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622528:0@lo:101: 00010000:00010000:1.0:1787787131.333267:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.333276:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.333341:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622656:0@lo:501: 00000100:00100000:1.0:1787787131.333374:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.333413:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.333551:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622656 00000100:00100000:2.0:1787787131.333557:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622656 00000100:00100000:2.0:1787787131.333636:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787787131.333645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503622656:12345-0@lo:501: 00000100:00100000:2.0:1787787131.333827:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503622656:12345-0@lo:501: Request processed in 174us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.333835:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787787131.333898:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622656:0@lo:501: 00000100:00100000:1.0:1787787131.333925:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622784:0@lo:503: 00000100:00100000:1.0:1787787131.333965:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.339654:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.339789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622784 00000100:00100000:0.0:1787787131.339800:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622784 00000100:00100000:0.0:1787787131.339865:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787787131.339876:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503622784:12345-0@lo:503: 00000100:00100000:0.0:1787787131.340083:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503622784:12345-0@lo:503: Request processed in 208us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.340091:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787787131.340242:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503622784:0@lo:503: 00000100:00100000:1.0:1787787131.340728:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10358:1874630503622912:0@lo:502: 00000100:00100000:1.0:1787787131.340791:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.340831:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.340882:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503622912 00000100:00100000:0.0:1787787131.340887:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503622912 00000100:00100000:0.0:1787787131.340910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787787131.340918:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:10358:x1874630503622912:12345-0@lo:502: 00000100:00100000:0.0:1787787131.341012:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+17:10358:x1874630503622912:12345-0@lo:502: Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.341019:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787787131.343370:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10358:1874630503622912:0@lo:502: 00000020:01000000:1.0:1787787131.343423:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787131.343437:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787131.343440:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787787131.343445:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787787131.343487:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10358:1874630503623040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.343558:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.343605:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.343735:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623040 00000100:00100000:2.0:1787787131.343743:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623040 00000100:00100000:2.0:1787787131.343793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787787131.343802:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:10358:x1874630503623040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787131.343939:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:10358:x1874630503623040:12345-0@lo:502:llog_process_th.0 Request processed in 137us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.343947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787787131.344129:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10358:1874630503623040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787131.344179:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787131.344184:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787131.344186:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787787131.344190:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787787131.348597:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787787131.348639:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787787131.348654:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.348668:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787131.348681:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787787131.348685:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870fc17b800 from 48 10000000:01000000:2.0:1787787131.348688:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787787131.348728:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.348737:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.348748:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787131.348791:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.348876:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.348926:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c53926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.348995:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623168 00000100:00100000:1.0:1787787131.349002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623168 00000100:00100000:1.0:1787787131.349050:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787787131.349059:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+17:6524:x1874630503623168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787131.349072:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787131.349084:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454fa00/0x11620bc3f30a8d42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.349108:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454fa00/0x11620bc3f30a8d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d3b expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.349119:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454fa00/0x11620bc3f30a8d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d3b expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.349166:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454fa00, rc 0) 00000100:00100000:1.0:1787787131.349225:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503623168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.349232:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787787131.349345:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787131.349360:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.349369:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787131.349425:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.349454:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.349480:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c53926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.349518:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623296 00000100:00100000:0.0:1787787131.349523:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623296 00000100:00100000:0.0:1787787131.349557:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787787131.349564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503623296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.349691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503623296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.349698:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787787131.352598:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.352666:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.352743:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.352785:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c53926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.352852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623424 00000100:00100000:1.0:1787787131.352859:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623424 00000100:00100000:1.0:1787787131.352915:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787787131.352925:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503623424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.353048:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503623424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.353056:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787787131.354164:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.355050:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10359:1874630503623552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.355118:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787131.355300:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.358075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623552 00000100:00100000:0.0:1787787131.358091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623552 00000100:00100000:0.0:1787787131.358428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787787131.358442:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:10359:x1874630503623552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787131.358630:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+18:10359:x1874630503623552:12345-0@lo:502:llog_process_th.0 Request processed in 190us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.358638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787787131.358750:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10359:1874630503623552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.358831:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10359:1874630503623680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.358877:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787131.375060:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.376745:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623680 00000100:00100000:1.0:1787787131.376759:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623680 00000100:00100000:0.0:1787787131.377577:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787787131.377587:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:10359:x1874630503623680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787131.377760:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:10359:x1874630503623680:12345-0@lo:502:llog_process_th.0 Request processed in 173us (18882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787131.377768:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787787131.377894:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10359:1874630503623680:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787787131.377931:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787787131.378093:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787787131.378121:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787131.378131:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.378177:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787131.378187:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787787131.378189:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787787131.378192:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787787131.378470:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.378488:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.378499:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787131.378520:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.378577:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.378622:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.378721:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623808 00000100:00100000:1.0:1787787131.378728:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623808 00000100:00100000:1.0:1787787131.378770:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787787131.378780:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+18:6524:x1874630503623808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787131.378789:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787131.378803:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454e200/0x11620bc3f30a8d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.378837:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454e200/0x11620bc3f30a8d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d49 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.378848:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454e200/0x11620bc3f30a8d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d49 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.378868:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e200, rc 0) 00000100:00100000:1.0:1787787131.378908:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503623808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.378914:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787787131.379007:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787131.379019:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.379028:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787131.379079:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.379103:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.379120:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.379339:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503623936 00000100:00100000:1.0:1787787131.379343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503623936 00000100:00100000:1.0:1787787131.379416:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787787131.379423:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503623936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.379535:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503623936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.379542:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787787131.379635:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503623936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.379662:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.379699:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.379781:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.379825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624064 00000100:00100000:3.0:1787787131.379829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624064 00000100:00100000:3.0:1787787131.379851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787787131.379857:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503624064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.379940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503624064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.379947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787787131.380018:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.380477:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10360:1874630503624192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787131.380518:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.380546:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.380594:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624192 00000100:00100000:3.0:1787787131.380598:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624192 00000100:00100000:3.0:1787787131.380627:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787787131.380634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:10360:x1874630503624192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.380720:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:10360:x1874630503624192:12345-0@lo:502:llog_process_th.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.380726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787787131.380829:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10360:1874630503624192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787131.380854:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787131.380862:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787131.380865:0:10360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787787131.380869:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787787131.380888:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10360:1874630503624320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787131.380919:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.380939:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.380982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624320 00000100:00100000:3.0:1787787131.380986:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624320 00000100:00100000:3.0:1787787131.381014:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787787131.381020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:10360:x1874630503624320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.381086:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:10360:x1874630503624320:12345-0@lo:502:llog_process_th.0 Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.381100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787787131.381324:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10360:1874630503624320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787131.381344:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787131.381348:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787131.381350:0:10360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787787131.381353:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1787787131.381491:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787787131.381512:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787787131.381522:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.381532:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787131.381540:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787787131.381543:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870d2373000 from 48 10000000:01000000:1.0:1787787131.381546:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787131.381567:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.381574:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.381594:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.381608:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.381640:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.381663:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.381727:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624448 00000100:00100000:3.0:1787787131.381732:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624448 00000100:00100000:3.0:1787787131.381762:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787787131.381768:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:6524:x1874630503624448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787131.381777:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787131.381789:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d57 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787131.381808:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d57 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787131.381875:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d57 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787131.381884:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6800, rc 0) 00000100:00100000:3.0:1787787131.381914:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503624448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.381920:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787787131.382054:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787131.382066:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.382074:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787131.382115:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.382171:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.382186:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.382402:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624576 00000100:00100000:2.0:1787787131.382407:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624576 00000100:00100000:2.0:1787787131.382445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787787131.382453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503624576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.382565:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503624576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.382573:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787787131.382658:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.382695:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.382732:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.382752:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.382797:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624704 00000100:00100000:2.0:1787787131.382801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624704 00000100:00100000:2.0:1787787131.382828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787787131.382834:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503624704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.382909:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503624704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.382915:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787787131.382983:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503624704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.383557:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10361:1874630503624832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.383595:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787131.383616:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.383666:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624832 00000100:00100000:2.0:1787787131.383671:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624832 00000100:00100000:2.0:1787787131.383703:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787787131.383710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:10361:x1874630503624832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787131.383811:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:10361:x1874630503624832:12345-0@lo:502:llog_process_th.0 Request processed in 101us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.383827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787787131.383901:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10361:1874630503624832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787131.383937:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10361:1874630503624960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787131.383968:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.383989:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.384032:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503624960 00000100:00100000:1.0:1787787131.384036:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503624960 00000100:00100000:1.0:1787787131.384069:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787787131.384075:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:10361:x1874630503624960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.384171:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:10361:x1874630503624960:12345-0@lo:502:llog_process_th.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.384179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787787131.384383:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10361:1874630503624960:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787787131.384403:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787787131.384543:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787787131.384584:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787131.384592:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.384602:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787131.384611:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787787131.384614:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1787787131.384617:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787787131.384640:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.384647:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.384664:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.384678:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.384709:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.384769:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787131.395882:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625088 00000100:00100000:0.0:1787787131.395899:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625088 00000100:00100000:2.0:1787787131.396729:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787787131.396740:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503625088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787131.396757:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787131.396775:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d65 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.396801:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d65 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.396812:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d65 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.396833:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1390c00, rc 0) 00000100:00100000:2.0:1787787131.396913:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503625088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (12203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.396933:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787787131.397009:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787131.397028:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.397038:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.397108:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.397164:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.405437:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.405688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625216 00000100:00100000:3.0:1787787131.405702:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625216 00000100:00100000:3.0:1787787131.405763:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787787131.405773:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503625216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.405967:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503625216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (8802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.405989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787787131.406100:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.406174:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.406235:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.406256:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.406303:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625344 00000100:00100000:2.0:1787787131.406307:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625344 00000100:00100000:2.0:1787787131.406330:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787787131.406336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503625344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.406419:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503625344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.406426:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787787131.406534:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.406934:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10362:1874630503625472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.406976:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.407004:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.407076:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625472 00000100:00100000:3.0:1787787131.407080:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625472 00000100:00100000:3.0:1787787131.407100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787787131.407106:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:10362:x1874630503625472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.407229:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:10362:x1874630503625472:12345-0@lo:502:llog_process_th.0 Request processed in 121us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.407235:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787787131.407375:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10362:1874630503625472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787131.407398:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787131.407407:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787131.407409:0:10362:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787787131.407414:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787787131.407433:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10362:1874630503625600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.407466:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.407493:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.407544:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625600 00000100:00100000:2.0:1787787131.407548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625600 00000100:00100000:2.0:1787787131.407569:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787787131.407576:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:10362:x1874630503625600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787131.407653:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:10362:x1874630503625600:12345-0@lo:502:llog_process_th.0 Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.407660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787787131.407889:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10362:1874630503625600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787131.407906:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787131.407909:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787131.407911:0:10362:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787787131.407914:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787787131.408060:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787787131.408080:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787787131.408089:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.408101:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787131.408111:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787787131.408114:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c3240800 from 48 10000000:01000000:2.0:1787787131.408117:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787787131.408178:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.408194:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.408204:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787131.409354:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.409409:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.409437:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c53929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.409537:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625728 00000100:00100000:3.0:1787787131.409545:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625728 00000100:00100000:3.0:1787787131.409580:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787787131.409589:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503625728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787131.409601:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787131.409616:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c7e00/0x11620bc3f30a8d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d73 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787131.409638:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c7e00/0x11620bc3f30a8d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d73 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787131.409648:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c7e00/0x11620bc3f30a8d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d73 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787131.409657:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7e00, rc 0) 00000100:00100000:3.0:1787787131.409691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503625728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.409697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787787131.410351:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787131.410370:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.410380:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787131.410451:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.410483:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.410510:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c53929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.410623:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625856 00000100:00100000:3.0:1787787131.410641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625856 00000100:00100000:3.0:1787787131.410677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787787131.410685:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503625856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.410788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503625856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.410794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787787131.410885:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.410909:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.410944:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.410962:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c53929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.411222:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503625984 00000100:00100000:3.0:1787787131.411226:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503625984 00000100:00100000:3.0:1787787131.412965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787787131.412984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503625984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.413152:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503625984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.413160:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787787131.413391:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503625984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.413640:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10363:1874630503626112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787131.413690:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.414076:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.414120:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626112 00000100:00100000:1.0:1787787131.414126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626112 00000100:00100000:1.0:1787787131.414188:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787787131.414197:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:10363:x1874630503626112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.423338:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:10363:x1874630503626112:12345-0@lo:502:llog_process_th.0 Request processed in 9132us (9638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.423354:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787787131.423593:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10363:1874630503626112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787131.423666:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10363:1874630503626240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787131.423717:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787131.423759:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787131.426766:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626240 00000100:00100000:1.0:1787787131.426781:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626240 00000100:00100000:1.0:1787787131.426846:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787787131.426856:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:10363:x1874630503626240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.427028:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:10363:x1874630503626240:12345-0@lo:502:llog_process_th.0 Request processed in 172us (3310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787131.427035:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787787131.427202:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10363:1874630503626240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787787131.427239:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787787131.428293:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787787131.428319:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787131.428329:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.428341:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787131.428352:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787787131.428354:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787787131.428357:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787131.428393:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.428401:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.428411:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.428430:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503626368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.428479:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.428519:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.428582:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626368 00000100:00100000:2.0:1787787131.428588:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626368 00000100:00100000:2.0:1787787131.428631:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787787131.428640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503626368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787131.428651:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787131.428664:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.428688:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d81 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.428699:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d81 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.428708:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391400, rc 0) 00000100:00100000:2.0:1787787131.428753:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503626368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.428760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787787131.428879:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503626368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787131.428894:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.428903:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.428969:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503626496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.428997:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.429020:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.429063:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626496 00000100:00100000:2.0:1787787131.429067:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626496 00000100:00100000:2.0:1787787131.429097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787787131.429104:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503626496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.429231:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503626496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.429238:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787787131.429427:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503626496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.429454:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503626624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.429494:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.429525:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.429566:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626624 00000100:00100000:3.0:1787787131.429570:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626624 00000100:00100000:3.0:1787787131.429603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787787131.429610:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503626624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787131.429691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503626624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.429697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787787131.429884:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503626624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.430226:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10364:1874630503626752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.430263:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.430280:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.430472:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626752 00000100:00100000:3.0:1787787131.430478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626752 00000100:00100000:3.0:1787787131.430506:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787787131.430513:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:10364:x1874630503626752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.430603:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:10364:x1874630503626752:12345-0@lo:502:llog_process_th.0 Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.430619:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787787131.430835:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10364:1874630503626752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787131.430857:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787131.430866:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787131.430868:0:10364:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787787131.430874:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787787131.430895:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10364:1874630503626880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787131.430929:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.430958:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787131.430998:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503626880 00000100:00100000:3.0:1787787131.431002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503626880 00000100:00100000:3.0:1787787131.431032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787787131.431039:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:10364:x1874630503626880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787131.431113:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:10364:x1874630503626880:12345-0@lo:502:llog_process_th.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787131.431119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787787131.431323:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10364:1874630503626880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787131.431340:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787131.431344:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787131.431346:0:10364:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787787131.431355:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787787131.431503:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787787131.431524:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787787131.431533:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.431542:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787131.431552:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787787131.431554:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9870d15599b8 from 1 10000000:01000000:0.0:1787787131.431557:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787131.431579:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.431597:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787131.431608:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787131.431623:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503627008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787131.431655:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787131.431680:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.431725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627008 00000100:00100000:2.0:1787787131.431730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627008 00000100:00100000:2.0:1787787131.431768:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787787131.431776:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503627008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787131.431785:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787131.431797:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c1391200/0x11620bc3f30a8d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8d8f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.431828:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c1391200/0x11620bc3f30a8d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8d8f expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.431839:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c1391200/0x11620bc3f30a8d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8d8f expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787131.431847:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391200, rc 0) 00000100:00100000:2.0:1787787131.431887:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503627008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787131.431894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787787131.432036:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503627008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787131.432050:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.432059:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787131.432106:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503627136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787131.432129:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787131.432177:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787131.432229:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627136 00000100:00100000:2.0:1787787131.432234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627136 00000100:00100000:2.0:1787787131.432257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787787131.432262:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503627136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787131.432335:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503627136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (204us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787131.432342:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787787131.432479:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503627136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787787131.432500:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787787131.432505:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.432513:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787131.689361:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787132.269660:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503627264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787132.269734:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.269831:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627264 00000100:00100000:1.0:1787787132.269839:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627264 00000100:00100000:0.0:1787787132.270866:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787787132.270878:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503627264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787132.270915:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787132.270977:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503627264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.270985:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787787132.273284:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503627264:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787787132.305462:0:10401:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc56847a90 20000000:00000080:0.0:1787787132.305479:0:10401:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff986fc3b6f400 uarg=0000000000000000 20000000:01000000:0.0:1787787132.305520:0:10401:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787787132.305526:0:10401:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787787132.305530:0:10401:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787787132.310349:0:10402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787787132.310962:0:10401:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787787132.317770:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787787132.317841:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787787132.319522:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787787132.319549:0:10401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787787132.319570:0:10401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319590:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a89de expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319598:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319604:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319611:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319620:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319628:0:10401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319674:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.319690:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 9 pid: 6520 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.319707:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627392:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787132.320988:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.321003:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 23 pid: 6520 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.321016:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3953840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627520:0@lo:104: 00000100:00100000:1.0:1787787132.321067:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787132.321114:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.321123:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 23 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.321132:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627648:0@lo:104: 00000100:00100000:1.0:1787787132.321171:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787132.321190:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.321198:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 23 pid: 6519 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.321206:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627776:0@lo:104: 00010000:00010000:1.0:1787787132.321227:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a89de expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.321234:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a89de expref: 23 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.321242:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627904:0@lo:104: 00000100:00100000:1.0:1787787132.321272:0:10401:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787132.321722:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787787132.321747:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.321764:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.321773:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627520 00000100:00100000:2.0:1787787132.321780:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627520 00000100:00100000:2.0:1787787132.321834:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627648 00000100:00100000:2.0:1787787132.321838:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627648 00000100:00100000:2.0:1787787132.321859:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627776 00000100:00100000:2.0:1787787132.321862:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627776 00000100:00100000:2.0:1787787132.321873:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503627904 00000100:00100000:2.0:1787787132.321875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503627904 00000100:00100000:2.0:1787787132.321888:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787132.321895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+6:10401:x1874630503627520:12345-0@lo:104: 00010000:00010000:2.0:1787787132.321908:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.321973:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787132.321979:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+6:10401:x1874630503627520:12345-0@lo:104: Request processed in 85us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.321986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787132.322004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787132.322010:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+5:10401:x1874630503627648:12345-0@lo:104: 00010000:00010000:2.0:1787787132.322018:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322071:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787787132.322084:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+5:10401:x1874630503627648:12345-0@lo:104: Request processed in 75us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.322090:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787132.322122:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787132.322129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:10401:x1874630503627776:12345-0@lo:104: 00010000:00010000:2.0:1787787132.322162:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322196:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787787132.322201:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:10401:x1874630503627776:12345-0@lo:104: Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.322206:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787132.322218:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787132.322224:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:10401:x1874630503627904:12345-0@lo:104: 00010000:00010000:2.0:1787787132.322231:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322255:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787787132.322260:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:10401:x1874630503627904:12345-0@lo:104: Request processed in 37us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.322265:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787787132.322281:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787787132.322287:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322294:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787132.322298:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322317:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787132.322324:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787132.322330:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787132.322357:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322363:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787132.322385:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322394:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15800/0x11620bc3f30a8bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8bc1 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322407:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787787132.322410:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322415:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787132.322418:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322424:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787132.322430:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787132.322441:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787132.322456:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322462:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787132.322469:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322475:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a8a94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a9b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322484:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787132.322487:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322493:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787132.322496:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322504:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787132.322511:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787132.322516:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787132.322528:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322533:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787132.322556:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322564:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322574:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787132.322578:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322584:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787132.322587:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322595:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787132.322602:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787132.322607:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787132.322620:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322626:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787132.322632:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322639:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15a00/0x11620bc3f30a89de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a89e5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.322652:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787132.322659:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787132.322660:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787132.322668:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787132.322682:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503628032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787132.322716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.322753:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787132.322759:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503628160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787132.322781:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.322827:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503628288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787132.322849:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.322866:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787132.322871:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503628416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787132.322893:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.322915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628032 00000100:00100000:2.0:1787787132.322920:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628032 00010000:00010000:2.0:1787787132.322941:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 24 pid: 6520 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787132.322957:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628160 00000100:00100000:2.0:1787787132.322959:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628160 00010000:00010000:2.0:1787787132.322985:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 25 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787132.322996:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628288 00000100:00100000:2.0:1787787132.322998:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628288 00010000:00010000:2.0:1787787132.323007:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 26 pid: 6519 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787132.323017:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628416 00000100:00100000:2.0:1787787132.323019:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628416 00010000:00010000:2.0:1787787132.323038:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89de expref: 27 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787132.323052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787132.323059:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+27:3653:x1874630503628032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787132.323069:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787132.323074:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 27 pid: 6520 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323083:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 27 pid: 6520 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323099:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787132.323128:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+27:3653:x1874630503628032:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.323134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787132.323172:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787132.323180:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+26:3653:x1874630503628160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787132.323188:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787132.323194:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 26 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323203:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 26 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787132.323213:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787132.323214:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787132.323240:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+26:3653:x1874630503628160:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.323246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787132.323264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787787132.323269:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+25:3655:x1874630503628288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787132.323275:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787132.323279:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 25 pid: 6519 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323286:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 25 pid: 6519 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323295:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787132.323330:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+25:3655:x1874630503628288:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.323336:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787787132.323348:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787132.323354:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3641c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503628416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787132.323360:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787132.323365:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a89de expref: 24 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323373:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a89de expref: 24 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.323382:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787132.323402:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3641c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503628416:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.323407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787132.323466:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503628160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787132.323475:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503628032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787132.323604:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503628416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787132.323614:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503628288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787132.324899:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14400/0x11620bc3f30a8bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8bba expref: 23 pid: 6520 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.324918:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627520:0@lo:104: 00010000:00010000:1.0:1787787132.324930:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8a9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8a94 expref: 22 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.324941:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627648:0@lo:104: 00010000:00010000:1.0:1787787132.324951:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8a39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8a32 expref: 21 pid: 6519 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.324959:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627776:0@lo:104: 00010000:00010000:1.0:1787787132.324968:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a89e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a89de expref: 20 pid: 6522 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.324976:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627904:0@lo:104: 00000100:00100000:0.0:1787787132.329332:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3953480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1874630503627392:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787132.329384:0:10401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.331719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787132.331807:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695424 00000100:00100000:2.0:1787787132.331816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695424 00010000:00010000:2.0:1787787132.331855:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 10 pid: 6520 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787132.331897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:2.0:1787787132.331907:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2391:x1874630484695424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787132.331922:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787132.331928:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 10 pid: 6520 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.331942:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 10 pid: 6520 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.331959:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8b800/0x11620bc3f30a8cd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fd6 expref: 10 pid: 6520 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.331974:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.331983:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.331998:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332006:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332013:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332034:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332040:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454ea00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787132.332044:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332068:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332088:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.332099:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787132.332185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:2391:x1874630484695424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 278us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.332194:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00010000:00010000:1.0:1787787132.332256:0:10401:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.332264:0:10401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.332270:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454ea00/0x11620bc3f30a8d9d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.713348:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787132.777427:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787132.777454:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503628544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787132.777524:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787132.777539:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787132.777549:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503628672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787132.777580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787132.777599:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628544 00000100:00100000:0.0:1787787132.777605:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628672 00000100:00100000:3.0:1787787132.777606:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628544 00000100:00100000:0.0:1787787132.777608:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628672 00000100:00100000:3.0:1787787132.777650:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787132.777650:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787787132.777657:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503628672:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787132.777671:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503628544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787132.777691:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1787787132.777695:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787132.777734:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503628544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.777734:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503628672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787132.777742:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787132.777742:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787787132.777762:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787787132.777777:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3569680 x1874630503628544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787132.777806:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503628544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787132.777806:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503628672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787132.777987:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503628800:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.777992:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503628928:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.778017:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787132.778030:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503629056:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.778040:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503629440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.778071:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787132.778081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787132.778097:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503629568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.778101:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628928 00000100:00100000:2.0:1787787132.778106:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628928 00000100:00100000:3.0:1787787132.778117:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.778131:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629056 00000100:00100000:3.0:1787787132.778132:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787132.778134:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629056 00000100:00100000:3.0:1787787132.778155:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503629184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.778172:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629568 00000100:00100000:2.0:1787787132.778175:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629568 00000100:00100000:3.0:1787787132.778177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787132.778188:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503629696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.778196:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629184 00000100:00100000:2.0:1787787132.778199:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629184 00000100:00100000:3.0:1787787132.778205:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787132.778210:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629696 00000100:00100000:2.0:1787787132.778212:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629696 00000100:00100000:3.0:1787787132.778225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787787132.778231:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503628928:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787787132.778264:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787132.778266:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503628928:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00080000:0.0:1787787132.778267:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787132.778363:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629440 00000100:00100000:0.0:1787787132.778366:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629440 00000100:00100000:0.0:1787787132.778398:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787132.778404:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503629440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.778436:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503629440:12345-0@lo:400:kworker.0 Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.778442:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787787132.778457:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787132.778464:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787132.778477:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503629312:0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.778505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787132.778524:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503629824:0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.778544:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787132.778561:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787132.778567:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503629952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787132.778588:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787132.778615:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629952 00000100:00100000:0.0:1787787132.778619:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629952 00000100:00100000:0.0:1787787132.778649:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787132.778656:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503629952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787132.778667:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787132.778696:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503629952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.778702:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787787132.778715:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787787132.778733:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3569e00 x1874630503629952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787132.778746:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503629952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787132.778775:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629312 00000100:00100000:0.0:1787787132.778778:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629312 00000100:00100000:0.0:1787787132.778815:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503629824 00000100:00100000:0.0:1787787132.778819:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503629824 00000100:00100000:0.0:1787787132.778848:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787132.778854:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503629312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.778888:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503629312:12345-0@lo:400:kworker.0 Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.778903:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787132.778916:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787132.778922:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503629824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.778947:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503629824:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.778952:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787787132.778967:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787132.778983:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e6580 x1874630503629312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787132.778992:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503629312:0@lo:400:kworker.0 00010000:00080000:0.0:1787787132.779000:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7c00 x1874630503629824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787132.779007:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503629824:0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.779270:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503628800 00000100:00100000:0.0:1787787132.779275:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503628800 00000100:00100000:2.0:1787787132.779548:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787787132.779559:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503629056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779606:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503629056:12345-0@lo:400:kworker.0 Request processed in 50us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.779612:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787787132.779626:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787787132.779632:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503629568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779655:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503629568:12345-0@lo:400:kworker.0 Request processed in 24us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.779660:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787787132.779670:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787132.779676:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503629184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779704:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503629184:12345-0@lo:400:kworker.0 Request processed in 29us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.779710:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787132.779722:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787787132.779728:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503629696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779751:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503629696:12345-0@lo:400:kworker.0 Request processed in 24us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.779756:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787787132.779810:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e61c0 x1874630503629184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787132.779845:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503629184:0@lo:400:kworker.0 00010000:00080000:2.0:1787787132.779859:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e52c0 x1874630503629696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787132.779867:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503629696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779877:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503629056:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779886:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503629568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787132.779925:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503628928:0@lo:400:kworker.0 00010000:00080000:2.0:1787787132.779935:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7480 x1874630503629440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787132.779944:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503629440:0@lo:400:kworker.0 00000100:00100000:3.0:1787787132.780295:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787132.789812:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787132.789844:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503628800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787132.790009:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503628800:12345-0@lo:400:kworker.0 Request processed in 183us (11541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787132.790017:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787787132.798246:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503628800:0@lo:400:kworker.0 10000000:01000000:1.0:1787787132.969922:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787132.969932:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f5ba1800 from 4 10000000:01000000:1.0:1787787132.969937:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787132.969996:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.970008:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.970018:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.970044:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.970179:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.970238:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787132.970522:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630080 00000100:00100000:2.0:1787787132.970530:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630080 00000100:00100000:2.0:1787787132.970595:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787787132.970604:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503630080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787132.970617:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787132.970631:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8da4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.970665:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.970677:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787132.970710:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787132.970759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503630080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787132.970765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787787132.972276:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.972302:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.972313:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.972406:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.972456:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.972492:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787132.972651:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630208 00000100:00100000:3.0:1787787132.972665:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630208 00000100:00100000:3.0:1787787132.972707:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787787132.972715:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503630208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787132.972891:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503630208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787132.972899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787787132.973503:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.973539:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.973593:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.973626:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787132.974033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630336 00000100:00100000:3.0:1787787132.974038:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630336 00000100:00100000:3.0:1787787132.974084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787787132.974092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503630336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787132.974219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503630336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787132.974226:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787787132.974798:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787132.977395:0:10417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10417:1874630503630464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787132.977483:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787132.977537:0:10417:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.977640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630464 00000100:00100000:1.0:1787787132.977663:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630464 00000100:00100000:1.0:1787787132.977711:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787787132.977719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:10417:x1874630503630464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.978116:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:10417:x1874630503630464:12345-0@lo:502:llog_process_th.0 Request processed in 394us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.978125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787787132.978423:0:10417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10417:1874630503630464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787132.978453:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787132.978461:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787132.978463:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787787132.978469:0:10417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870f5ba1800 00000020:00000080:0.0:1787787132.978472:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787787132.981046:0:10417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10417:1874630503630592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.981125:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.981187:0:10417:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.981228:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630592 00000100:00100000:1.0:1787787132.981236:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630592 00000100:00100000:1.0:1787787132.981285:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787787132.981294:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:10417:x1874630503630592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.981417:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:10417:x1874630503630592:12345-0@lo:502:llog_process_th.0 Request processed in 123us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.981424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787787132.981476:0:10417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10417:1874630503630592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787132.981499:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787132.981506:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787132.981508:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787787132.981512:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787787132.981577:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787787132.981596:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787132.981605:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981617:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787132.981635:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787132.981638:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc17b800 from 4 10000000:01000000:1.0:1787787132.981641:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787132.981663:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981670:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981679:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.981693:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.981721:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.981736:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.981749:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630720 00000100:00100000:1.0:1787787132.981752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630720 00000100:00100000:1.0:1787787132.981775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787787132.981781:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503630720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.981802:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787132.981815:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8db2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981854:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981866:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981885:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454f400, rc 0) 00000100:00100000:1.0:1787787132.981917:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503630720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.981923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787787132.981952:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.981964:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.981973:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.982021:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.982045:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.982057:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.982068:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630848 00000100:00100000:1.0:1787787132.982071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630848 00000100:00100000:1.0:1787787132.982090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787787132.982096:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503630848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.982213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503630848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.982220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787787132.982248:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.982271:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.982302:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.982319:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.982329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503630976 00000100:00100000:1.0:1787787132.982332:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503630976 00000100:00100000:1.0:1787787132.982351:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787787132.982357:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503630976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.982423:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503630976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.982429:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787787132.982467:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503630976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.982699:0:10419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10419:1874630503631104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.982734:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.982753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631104 00000100:00100000:1.0:1787787132.982757:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631104 00000100:00100000:1.0:1787787132.982777:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787787132.982782:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:10419:x1874630503631104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.982863:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:10419:x1874630503631104:12345-0@lo:502:llog_process_th.0 Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.982869:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787787132.982896:0:10419:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.982906:0:10419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10419:1874630503631104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787132.982922:0:10419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787132.982929:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787132.982931:0:10419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787787132.982937:0:10419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870fc17b800 00000020:00000080:1.0:1787787132.982938:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787787132.990851:0:10419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10419:1874630503631232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.990939:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.990985:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631232 00000100:00100000:1.0:1787787132.990991:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631232 00000100:00100000:1.0:1787787132.991034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787787132.991042:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:10419:x1874630503631232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.991157:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:10419:x1874630503631232:12345-0@lo:502:llog_process_th.0 Request processed in 115us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.991164:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787787132.991213:0:10419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.991233:0:10419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10419:1874630503631232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787132.991258:0:10419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787132.991265:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787132.991267:0:10419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787787132.991271:0:10419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787787132.991325:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787787132.991342:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787132.991352:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991362:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787132.991372:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787132.991375:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870d2373000 from 4 10000000:01000000:1.0:1787787132.991378:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787132.991399:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991406:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991421:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.991434:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503631360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.991459:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.991474:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.991486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631360 00000100:00100000:1.0:1787787132.991489:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631360 00000100:00100000:1.0:1787787132.991511:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787787132.991517:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503631360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.991525:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787132.991536:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8dc0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991557:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991567:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991574:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e800, rc 0) 00000100:00100000:1.0:1787787132.991601:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503631360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.991607:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787787132.991637:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503631360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.991647:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.991674:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.991718:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503631488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.991742:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.991754:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.991764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631488 00000100:00100000:1.0:1787787132.991767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631488 00000100:00100000:1.0:1787787132.991802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787787132.991808:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503631488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.991884:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503631488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.991891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787787132.991915:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503631488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.991935:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503631616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.991963:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.991974:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.991982:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631616 00000100:00100000:1.0:1787787132.991985:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631616 00000100:00100000:1.0:1787787132.992001:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787787132.992006:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503631616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.992061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503631616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.992067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787787132.992100:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503631616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.992317:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10421:1874630503631744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.992348:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.992365:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631744 00000100:00100000:1.0:1787787132.992368:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631744 00000100:00100000:1.0:1787787132.992388:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787787132.992394:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:10421:x1874630503631744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.992449:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:10421:x1874630503631744:12345-0@lo:502:llog_process_th.0 Request processed in 55us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.992455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787787132.992479:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.992488:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10421:1874630503631744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787132.992503:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787132.992510:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787132.992512:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787787132.992517:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870d2373000 00000020:00000080:1.0:1787787132.992520:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787787132.992570:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10421:1874630503631872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.992598:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.992614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503631872 00000100:00100000:1.0:1787787132.992617:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503631872 00000100:00100000:1.0:1787787132.992631:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787787132.992636:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:10421:x1874630503631872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787132.992683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:10421:x1874630503631872:12345-0@lo:502:llog_process_th.0 Request processed in 46us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.992689:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787787132.992716:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.992725:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10421:1874630503631872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787132.992739:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787132.992743:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787132.992744:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787787132.992747:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787787132.992778:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787787132.992812:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787132.992820:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.992829:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787132.992837:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787132.992839:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3240800 from 4 10000000:01000000:1.0:1787787132.992842:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787132.992857:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.992865:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.992872:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.992882:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503632000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.992906:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.992917:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.992926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632000 00000100:00100000:1.0:1787787132.992934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632000 00000100:00100000:1.0:1787787132.992951:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787787132.992956:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503632000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.992963:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787132.992973:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8dce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.992989:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.992998:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.993006:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4800, rc 0) 00000100:00100000:1.0:1787787132.993029:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503632000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.993035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787787132.993058:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503632000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787132.993068:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787132.993076:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787132.993109:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503632128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.993129:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.993164:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.993173:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632128 00000100:00100000:1.0:1787787132.993180:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632128 00000100:00100000:1.0:1787787132.993198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787787132.993203:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503632128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.993261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503632128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.993267:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787787132.993290:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503632128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.993308:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503632256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.993336:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787132.993346:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787132.993355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632256 00000100:00100000:1.0:1787787132.993358:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632256 00000100:00100000:1.0:1787787132.993376:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787787132.993381:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503632256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787132.993435:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503632256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787132.993442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787787132.993471:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503632256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787133.011444:0:10422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10422:1874630503632384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787133.011540:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787133.011586:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632384 00000100:00100000:1.0:1787787133.011592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632384 00000100:00100000:1.0:1787787133.011639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787787133.011648:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:10422:x1874630503632384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787133.012710:0:10422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fa0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787133.014087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:10422:x1874630503632384:12345-0@lo:502:llog_process_th.0 Request processed in 2436us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787133.014105:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787787133.020108:0:10422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10422:1874630503632384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787133.020175:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787133.020187:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787133.020190:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787787133.020198:0:10422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870c3240800 00000020:00000080:2.0:1787787133.020201:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787787133.020294:0:10422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10422:1874630503632512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787133.020361:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787133.020401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632512 00000100:00100000:2.0:1787787133.020407:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632512 00000100:00100000:2.0:1787787133.020453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787787133.020461:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:10422:x1874630503632512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787133.020565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:10422:x1874630503632512:12345-0@lo:502:llog_process_th.0 Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787133.020573:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787787133.020616:0:10422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cac000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787133.020627:0:10422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:10422:1874630503632512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787133.020642:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787133.020646:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787133.020648:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787787133.021283:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787787133.022980:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787787133.023009:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787133.023020:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787133.023032:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787133.739256:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787133.937480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787133.937555:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695552 00000100:00100000:1.0:1787787133.937565:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695552 00000100:00100000:1.0:1787787133.940059:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 269 00000100:00100000:1.0:1787787133.940081:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:6164:x1874630484695552:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787133.940100:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787133.940133:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c801c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787133.940177:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787133.940189:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787133.940200:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4000, rc 0) 00000100:00100000:1.0:1787787133.940268:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695552:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 195us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787133.940276:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 269 00000100:00100000:3.0:1787787133.957380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787133.957744:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695680 00000100:00100000:1.0:1787787133.957760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695680 00000100:00100000:1.0:1787787133.957834:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 270 00000100:00100000:1.0:1787787133.957844:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695680:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787133.957997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695680:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 154us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787133.958005:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 270 00000100:00100000:1.0:1787787133.982676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787133.983558:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695808 00000100:00100000:2.0:1787787133.983571:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695808 00000100:00100000:2.0:1787787133.983627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 271 00000100:00100000:2.0:1787787133.983637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695808:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787133.983793:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6164:x1874630484695808:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 157us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787133.983801:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 271 00000100:00100000:0.0:1787787133.993534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787133.994031:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484695936 00000100:00100000:1.0:1787787133.994042:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484695936 00000100:00100000:1.0:1787787133.994207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 272 00000100:00100000:1.0:1787787133.994217:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6701:x1874630484695936:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787133.994367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6701:x1874630484695936:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 151us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787133.994376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 272 00000100:00100000:0.0:1787787134.001952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787134.002189:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696064 00000100:00100000:1.0:1787787134.002200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696064 00000100:00100000:1.0:1787787134.002251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 273 00000100:00100000:1.0:1787787134.002260:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6701:x1874630484696064:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787134.002393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:6701:x1874630484696064:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 134us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787134.002401:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 273 00010000:00010000:1.0:1787787134.762285:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787135.337408:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503632640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787135.337524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787135.337675:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632640 00000100:00100000:0.0:1787787135.337683:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632640 00000100:00100000:0.0:1787787135.337761:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787135.337772:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503632640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787135.337803:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787135.337852:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503632640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787135.337860:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787787135.337898:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a76580 x1874630503632640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787135.337917:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503632640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787135.337981:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787135.339303:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787135.344256:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503632768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787135.344336:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787135.344826:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632768 00000100:00100000:3.0:1787787135.344837:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632768 00000100:00100000:3.0:1787787135.344915:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787787135.344925:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503632768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787135.344949:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787135.345012:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503632768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787135.345020:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787787135.345102:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787135.345183:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a76580 x1874630503632768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787135.345204:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503632768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787135.663585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787135.663630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787135.663662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787135.663697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787135.663749:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696704 00000100:00100000:2.0:1787787135.663757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787135.663758:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696704 00000100:00100000:1.0:1787787135.663823:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696576 00000100:00100000:1.0:1787787135.663827:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696576 00000100:00100000:0.0:1787787135.663850:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696192 00000100:00100000:1.0:1787787135.663854:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:0.0:1787787135.663855:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696192 00000100:00100000:1.0:1787787135.663863:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484696704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787135.663893:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 274 00000100:00100000:0.0:1787787135.663900:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2393:x1874630484696192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787135.663965:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696448 00000100:00100000:3.0:1787787135.663969:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696448 00000100:00100000:3.0:1787787135.664012:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696320 00000100:00100000:3.0:1787787135.664015:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696320 00000100:00100000:0.0:1787787135.664047:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2393:x1874630484696192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787135.664057:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 274 00000100:00100000:0.0:1787787135.664099:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:0.0:1787787135.664106:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484696576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787135.665075:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484696704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1207us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787135.665086:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00080000:1.0:1787787135.665113:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787135.665117:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787135.665120:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787135.665122:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787135.666349:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:3.0:1787787135.666372:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484696448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787135.668622:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484696576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4501us (4849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787135.668637:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787135.668973:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484696448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2609us (5340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787135.669006:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:3.0:1787787135.669029:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:3.0:1787787135.669041:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484696320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787135.669078:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484696320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (5381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787135.669084:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00010000:00010000:2.0:1787787135.786470:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787136.816413:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787137.386383:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787137.386411:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503632896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787137.386541:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.386658:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503632896 00000100:00100000:1.0:1787787137.386667:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503632896 00000100:00100000:1.0:1787787137.386740:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787137.386750:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5859a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503632896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787137.386795:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787137.386848:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5859a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503632896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.386854:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787137.386900:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503632896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787137.833778:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787137.897971:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503633024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898054:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898098:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503633536:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898124:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898165:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503634048:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898204:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898223:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4141e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503634560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898256:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898281:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787787137.898287:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503633408:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898313:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898331:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503633920:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898350:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898366:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4143840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503634432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898388:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898418:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503633152:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898457:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4140780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503633664:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898475:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898491:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503634176:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898541:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787787137.898546:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503633280:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898632:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4142940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503633792:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898668:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898680:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4143c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503634304:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.898740:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633024 00000100:00100000:1.0:1787787137.898753:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633024 00000100:00100000:1.0:1787787137.898799:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787787137.898807:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503633024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898861:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503633024:12345-0@lo:400:kworker.0 Request processed in 55us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.898869:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787787137.898906:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633536 00000100:00100000:1.0:1787787137.898910:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633536 00000100:00100000:1.0:1787787137.898926:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633280 00000100:00100000:1.0:1787787137.898928:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633280 00000100:00100000:1.0:1787787137.898942:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787137.898948:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4142580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503633536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.898981:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4142580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503633536:12345-0@lo:400:kworker.0 Request processed in 32us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.898987:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787137.898997:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787787137.899003:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503633280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899035:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503633280:12345-0@lo:400:kworker.0 Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899041:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787787137.899059:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634048 00000100:00100000:1.0:1787787137.899062:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634048 00000100:00100000:1.0:1787787137.899088:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634560 00000100:00100000:1.0:1787787137.899091:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634560 00000100:00100000:1.0:1787787137.899101:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633920 00000100:00100000:1.0:1787787137.899103:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633920 00000100:00100000:1.0:1787787137.899113:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634432 00000100:00100000:1.0:1787787137.899115:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634432 00000100:00100000:1.0:1787787137.899126:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787137.899159:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503634048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899187:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503634048:12345-0@lo:400:kworker.0 Request processed in 49us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899192:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787137.899202:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787137.899207:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503634560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899241:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503634560:12345-0@lo:400:kworker.0 Request processed in 33us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899247:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787137.899256:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787137.899261:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503633920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899279:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503633920:12345-0@lo:400:kworker.0 Request processed in 19us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899284:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787137.899292:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787137.899297:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503634432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899314:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503634432:12345-0@lo:400:kworker.0 Request processed in 17us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899319:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787137.899337:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633408 00000100:00100000:1.0:1787787137.899339:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633408 00000100:00100000:1.0:1787787137.899353:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633152 00000100:00100000:1.0:1787787137.899355:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633152 00000100:00100000:1.0:1787787137.899363:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633664 00000100:00100000:1.0:1787787137.899365:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633664 00000100:00100000:1.0:1787787137.899375:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634176 00000100:00100000:1.0:1787787137.899377:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634176 00000100:00100000:1.0:1787787137.899394:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503633792 00000100:00100000:1.0:1787787137.899397:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503633792 00000100:00100000:1.0:1787787137.899406:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634304 00000100:00100000:1.0:1787787137.899408:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634304 00000100:00100000:1.0:1787787137.899421:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787137.899426:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4142d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503633408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899451:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4142d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503633408:12345-0@lo:400:kworker.0 Request processed in 25us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899457:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787137.899466:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787137.899470:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4141680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503633152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899489:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4141680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503633152:12345-0@lo:400:kworker.0 Request processed in 19us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899494:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787137.899502:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787137.899507:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503633664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899525:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503633664:12345-0@lo:400:kworker.0 Request processed in 19us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899530:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787137.899538:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787137.899543:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4141a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503634176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899560:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4141a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503634176:12345-0@lo:400:kworker.0 Request processed in 17us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899566:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787137.899574:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787137.899578:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503633792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899608:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503633792:12345-0@lo:400:kworker.0 Request processed in 29us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899614:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787137.899623:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787137.899628:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503634304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899646:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503634304:12345-0@lo:400:kworker.0 Request processed in 18us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787137.899651:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787787137.899700:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787137.899704:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787137.899706:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787137.899709:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787137.899737:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503633280:0@lo:400:kworker.0 00010000:00080000:1.0:1787787137.899749:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4142940 x1874630503633792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.899759:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4142940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503633792:0@lo:400:kworker.0 00010000:00080000:1.0:1787787137.899768:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4143c00 x1874630503634304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.899776:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4143c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503634304:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899785:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503633152:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899792:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4140780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503633664:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899800:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503634176:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899830:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503633408:0@lo:400:kworker.0 00010000:00080000:1.0:1787787137.899847:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4140000 x1874630503633920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.899856:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503633920:0@lo:400:kworker.0 00010000:00080000:1.0:1787787137.899865:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4143840 x1874630503634432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.899873:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4143840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503634432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899882:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503633024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.899890:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503633536:0@lo:400:kworker.0 00010000:00080000:1.0:1787787137.899899:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41421c0 x1874630503634048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.899907:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503634048:0@lo:400:kworker.0 00010000:00080000:1.0:1787787137.899916:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4141e00 x1874630503634560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.899924:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4141e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503634560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787137.903497:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503634816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787137.903644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787137.903851:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503634944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787137.904040:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634816 00000100:00100000:2.0:1787787137.904049:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634816 00000100:00100000:2.0:1787787137.904100:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787137.904109:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503634816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787137.904154:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787137.904331:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787137.904640:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787137.904650:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503634688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787137.907388:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503634816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3271us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787137.907403:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787137.907432:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634944 00000100:00100000:2.0:1787787137.907440:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634944 00000100:00100000:2.0:1787787137.907474:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787137.907481:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503634944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787787137.907505:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787137.907555:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503634944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787137.907561:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787787137.909179:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4171e00 x1874630503634944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787137.909203:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503634944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787137.909672:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787787137.910029:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4173840 x1874630503634816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787137.910047:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503634816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787137.910125:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503634688 00000100:00100000:0.0:1787787137.910132:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503634688 00000100:00100000:0.0:1787787137.910195:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787137.910204:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503634688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787137.910245:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787787137.910340:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503634688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787137.910347:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787137.910382:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503634688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787787138.863562:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787139.153889:0:10701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787787139.883209:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787140.461342:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503635072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787140.461415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787140.461458:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503635200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787140.461492:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787140.461676:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635072 00000100:00100000:0.0:1787787140.461693:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635072 00000100:00100000:0.0:1787787140.461749:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635200 00000100:00100000:0.0:1787787140.461752:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635200 00000100:00100000:0.0:1787787140.461772:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787140.461781:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503635072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787140.461809:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787140.461857:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503635072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787140.461866:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787140.461882:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787140.461888:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503635200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787140.461899:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787140.461944:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503635200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787140.461950:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787787140.461995:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403f0c0 x1874630503635200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787140.462014:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503635200:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787787140.462047:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a752c0 x1874630503635072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787140.462060:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503635072:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787787140.463623:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787140.786606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787140.786660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787140.786698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787140.786720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787140.786754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787140.786784:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697088 00000100:00100000:1.0:1787787140.786793:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697088 00000100:00100000:1.0:1787787140.786848:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696960 00000100:00100000:1.0:1787787140.786851:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696960 00000100:00100000:1.0:1787787140.786875:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:1.0:1787787140.786886:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484697088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787140.786960:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484697088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787140.786967:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:1.0:1787787140.786984:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:1.0:1787787140.786991:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484696960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787140.787017:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484696960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787140.787023:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:1.0:1787787140.787041:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697344 00000100:00100000:1.0:1787787140.787044:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697344 00000100:00100000:1.0:1787787140.787067:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697216 00000100:00100000:1.0:1787787140.787070:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697216 00000100:00100000:1.0:1787787140.787089:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:1.0:1787787140.787096:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484697344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787140.787134:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484697344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787140.787169:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:1.0:1787787140.787182:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:1.0:1787787140.787189:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484697216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787140.787213:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484697216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787140.787219:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00080000:1.0:1787787140.787241:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787140.787245:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787140.787247:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787140.787249:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787140.788086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484696832 00000100:00100000:3.0:1787787140.788093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484696832 00000100:00100000:3.0:1787787140.788127:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 276 00000100:00100000:3.0:1787787140.788135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484696832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787140.788200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484696832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787140.788208:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 276 00010000:00010000:1.0:1787787140.906359:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787141.930608:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787142.505449:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503635328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787142.505536:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787142.506423:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635328 00000100:00100000:2.0:1787787142.506434:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635328 00000100:00100000:2.0:1787787142.506496:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787787142.506506:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503635328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787142.506541:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787142.506688:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503635328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787142.506708:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787142.506736:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503635328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787142.953378:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787143.017411:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503635584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787143.017492:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787143.017567:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635584 00000100:00100000:3.0:1787787143.017575:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635584 00000100:00080000:1.0:1787787143.017615:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787143.017657:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787143.017667:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503635584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787143.017804:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787143.017926:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503635584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 261us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787143.017934:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787787143.018243:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403c780 x1874630503635584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787143.018264:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503635584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787143.018283:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503635968:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018316:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018338:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503636480:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787143.018365:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503635840:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018378:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503636992:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018398:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018431:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787787143.018447:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503635456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787143.018475:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018496:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503636096:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.018501:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018515:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018526:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503636608:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.018526:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503636352:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.018546:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018547:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787143.018557:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503636864:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018559:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503637120:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018576:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787143.018578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018606:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635968 00000100:00100000:0.0:1787787143.018607:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787787143.018610:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635968 00000100:00100000:0.0:1787787143.018621:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503635712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787143.018635:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636480 00000100:00100000:1.0:1787787143.018638:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636480 00000100:00100000:0.0:1787787143.018645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787143.018658:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636992 00000100:00100000:0.0:1787787143.018659:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503636224:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018660:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636992 00000100:00100000:1.0:1787787143.018674:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636608 00000100:00100000:1.0:1787787143.018676:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636608 00000100:00100000:0.0:1787787143.018678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787143.018686:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503636736:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.018687:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637120 00000100:00100000:1.0:1787787143.018689:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637120 00000100:00100000:1.0:1787787143.018717:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636224 00000100:00100000:1.0:1787787143.018720:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636224 00000100:00100000:1.0:1787787143.018734:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787787143.018740:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503635968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787143.018921:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635456 00000100:00100000:3.0:1787787143.018925:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635456 00000100:00100000:3.0:1787787143.018944:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636096 00000100:00100000:3.0:1787787143.018947:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636096 00000100:00100000:3.0:1787787143.018967:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636352 00000100:00100000:3.0:1787787143.018969:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636352 00000100:00100000:3.0:1787787143.018990:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787143.018995:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503635456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787143.019028:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787787143.021130:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503635968:12345-0@lo:400:kworker.0 Request processed in 2381us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021159:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787787143.021199:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787143.021211:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503636480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.021255:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503636480:12345-0@lo:400:kworker.0 Request processed in 49us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787143.021286:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787143.021293:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.021340:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503636992:12345-0@lo:400:kworker.0 Request processed in 47us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021347:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787143.021362:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787787143.021369:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503636608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.021399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503636608:12345-0@lo:400:kworker.0 Request processed in 31us (2852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021404:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787787143.021539:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787787143.021547:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503637120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.021580:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503637120:12345-0@lo:400:kworker.0 Request processed in 35us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021586:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787787143.021611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787143.021618:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503636224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.021650:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503636224:12345-0@lo:400:kworker.0 Request processed in 33us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021655:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787143.021767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635840 00000100:00100000:1.0:1787787143.021774:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635840 00000100:00100000:1.0:1787787143.021814:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787787143.021821:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503635840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.021927:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503635840:12345-0@lo:400:kworker.0 Request processed in 107us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.021934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787787143.021970:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636864 00000100:00100000:1.0:1787787143.021975:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636864 00000100:00100000:1.0:1787787143.022005:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787787143.022012:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503636864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.022044:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503636864:12345-0@lo:400:kworker.0 Request processed in 32us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787143.022050:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787787143.022256:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787143.022261:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787143.022264:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787143.022295:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5a40 x1874630503636608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787143.022311:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503636608:0@lo:400:kworker.0 00010000:00080000:1.0:1787787143.022323:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e61c0 x1874630503637120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787143.022332:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503637120:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.022345:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503636992:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.022355:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503635968:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.022365:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503636480:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.022582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787143.022630:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503637248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.022658:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787143.022683:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503635840:0@lo:400:kworker.0 00010000:00080000:0.0:1787787143.022757:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5e00 x1874630503636864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787143.022766:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503636864:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.022786:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503636224:0@lo:400:kworker.0 00000100:00100000:3.0:1787787143.022962:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503635456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3964us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787143.022972:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787143.022993:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787143.023002:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503636096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787143.023036:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503636096:12345-0@lo:400:kworker.0 Request processed in 37us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787143.023042:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787143.023053:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787787143.023060:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503636352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787143.023097:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503636352:12345-0@lo:400:kworker.0 Request processed in 37us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787143.023102:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787787143.023122:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503635712 00000100:00100000:3.0:1787787143.023126:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503635712 00000100:00100000:3.0:1787787143.023176:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787143.023182:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503635712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787143.023198:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787143.023230:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503635712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (4584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787143.023236:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787787143.023257:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787787143.023274:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4171680 x1874630503635712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787143.023288:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503635712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787143.023308:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503636352:0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.023392:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503635456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787143.023402:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503636096:0@lo:400:kworker.0 00000100:00100000:1.0:1787787143.023688:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503636736 00000100:00100000:1.0:1787787143.023764:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503636736 00000100:00100000:1.0:1787787143.023848:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637248 00000100:00100000:1.0:1787787143.023852:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637248 00000100:00080000:3.0:1787787143.023953:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787143.023990:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787143.024000:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503636736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.024086:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503636736:12345-0@lo:400:kworker.0 Request processed in 88us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787143.024093:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787143.024106:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787143.024111:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503637248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787143.024154:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503637248:12345-0@lo:400:kworker.0 Request processed in 27us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787143.024161:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787787143.024530:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7840 x1874630503636736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787143.024543:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503636736:0@lo:400:kworker.0 00010000:00080000:3.0:1787787143.024555:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7c00 x1874630503637248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787143.024564:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503637248:0@lo:400:kworker.0 00010000:00010000:1.0:1787787143.977556:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787144.528994:0:10945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing yml_node 00010000:00010000:3.0:1787787145.001602:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787145.578808:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503637504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787145.578877:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787145.586437:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787145.586470:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503637376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787145.586569:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787145.587163:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637504 00000100:00100000:1.0:1787787145.587173:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637504 00000100:00100000:1.0:1787787145.587238:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637376 00000100:00100000:1.0:1787787145.587242:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637376 00000100:00100000:1.0:1787787145.587259:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787787145.587267:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503637504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787145.587298:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787145.587350:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503637504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (8473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787145.587356:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787787145.587373:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787787145.587380:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503637376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787145.587389:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787145.587414:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503637376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787145.587419:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787787145.587460:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc306d00 x1874630503637504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787145.587479:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503637504:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787787145.587505:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc307480 x1874630503637376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787145.587516:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503637376:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787787145.587789:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787145.923968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787145.924059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787145.924115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787145.924343:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697728 00000100:00100000:0.0:1787787145.924359:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697728 00000100:00100000:0.0:1787787145.924453:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697600 00000100:00100000:0.0:1787787145.924456:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697600 00000100:00100000:0.0:1787787145.924483:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:0.0:1787787145.924494:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484697728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787145.924606:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484697728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 114us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787145.924614:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:0.0:1787787145.924644:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:0.0:1787787145.924659:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484697600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787145.924691:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484697600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787145.924698:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00080000:2.0:1787787145.925799:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787145.925809:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787145.926182:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697472 00000100:00100000:1.0:1787787145.926208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697472 00000100:00100000:1.0:1787787145.926281:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 278 00000100:00100000:1.0:1787787145.926292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2391:x1874630484697472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787145.926361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2391:x1874630484697472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787145.926369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 278 00000100:00100000:1.0:1787787145.930917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787145.931039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787145.931324:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697856 00000100:00100000:0.0:1787787145.931340:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697856 00000100:00100000:0.0:1787787145.931443:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484697984 00000100:00100000:0.0:1787787145.931447:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484697984 00000100:00100000:0.0:1787787145.931481:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00080000:1.0:1787787145.934328:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787145.934346:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787145.934430:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787145.934460:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2390:x1874630484697984:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:1.0:1787787145.934542:0:9030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8cf5 00000100:00100000:0.0:1787787145.935358:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2390:x1874630484697856:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1787787145.935395:0:8443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8cee 00000100:00080000:0.0:1787787145.935408:0:8443:0:(import.c:65:import_set_state_nolock()) ffff9870fc314000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787145.935589:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787787145.936756:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787145.940043:0:9030:0:(import.c:65:import_set_state_nolock()) ffff9870f4591800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787145.940191:0:9030:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787787145.940470:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+2:2390:x1874630484697984:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 6020us (9422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787145.940485:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:0.0:1787787145.941171:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+2:2390:x1874630484697856:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 9676us (10268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787145.941183:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00010000:00010000:2.0:1787787145.941355:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787146.026929:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787147.049506:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787147.625765:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787147.625797:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503637632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787147.625894:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787147.626306:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637632 00000100:00100000:2.0:1787787147.626317:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637632 00000100:00100000:2.0:1787787147.626382:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787787147.626394:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503637632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787147.626443:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787147.626527:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503637632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787147.626535:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787147.626708:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503637632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787148.074269:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787148.137821:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787148.137853:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503637760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787148.137952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787148.138050:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637760 00000100:00100000:0.0:1787787148.138061:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637760 00000100:00100000:0.0:1787787148.138126:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787148.138179:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503637760:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787148.138181:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503637888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787148.138273:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787148.138345:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503637888 00000100:00100000:1.0:1787787148.138355:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503637888 00000100:00100000:1.0:1787787148.138427:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787148.138439:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503637888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787148.138470:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787148.138555:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503637888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787148.138564:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787787148.138595:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:0.0:1787787148.138742:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787787148.138804:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503637760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 638us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787148.138812:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787148.140448:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503638144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787148.140470:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503638272:0@lo:400:kworker.0 00010000:00080000:1.0:1787787148.140594:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f7a940 x1874630503637888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787148.140710:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503637888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787148.140758:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503637760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787148.140809:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503638016:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.142828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787148.142839:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787148.142980:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638144 00000100:00100000:0.0:1787787148.142993:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638144 00000100:00100000:0.0:1787787148.143074:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787148.143086:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503638144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787148.143127:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787148.143213:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503638144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787148.143222:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787787148.143248:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787148.143267:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638272 00000100:00100000:0.0:1787787148.143271:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638272 00000100:00100000:0.0:1787787148.143304:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787148.143311:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503638272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.146728:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503638272:12345-0@lo:400:kworker.0 Request processed in 3404us (3899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787148.146746:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787787148.146851:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b0b40 x1874630503638144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787148.146885:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503638144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787148.146964:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503638400:0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.147039:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787148.147202:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787148.147272:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638016 00000100:00100000:1.0:1787787148.147282:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638016 00000100:00100000:1.0:1787787148.147339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787787148.147348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503638016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787148.147410:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503638016:12345-0@lo:400:kworker.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787148.147418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787787148.147502:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503638016:0@lo:400:kworker.0 00000100:00100000:1.0:1787787148.147587:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638400 00000100:00100000:1.0:1787787148.147593:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638400 00000100:00100000:3.0:1787787148.149910:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503638528:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.150001:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787148.150007:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787148.150046:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503638400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.150082:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638528 00000100:00100000:3.0:1787787148.150092:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638528 00000100:00100000:3.0:1787787148.150166:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787787148.150176:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503638528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.150237:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503638528:12345-0@lo:400:kworker.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787148.150246:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787787148.150296:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503638528:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.150346:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787148.150352:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503638656:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.150381:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787148.150409:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638656 00000100:00100000:3.0:1787787148.150413:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638656 00000100:00100000:3.0:1787787148.150454:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787787148.150461:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503638656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787148.151589:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503638400:12345-0@lo:400:kworker.0 Request processed in 1553us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787148.151602:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787787148.151692:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503638656:12345-0@lo:400:kworker.0 Request processed in 1224us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787148.151703:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1787787148.151752:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787148.151792:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503638656:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.151946:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503639040:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.151996:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787148.152037:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639040 00000100:00100000:3.0:1787787148.152043:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639040 00000100:00100000:3.0:1787787148.152093:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787148.152103:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503639040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.152165:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503639040:12345-0@lo:400:kworker.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787148.152172:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787787148.152190:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787148.152207:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403cb40 x1874630503639040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787148.152220:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503639040:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.152248:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787148.152263:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503639168:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.152290:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787148.152311:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639168 00000100:00100000:3.0:1787787148.152315:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639168 00000100:00100000:3.0:1787787148.152346:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787787148.152352:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9645680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503639168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.152385:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9645680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503639168:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787148.152391:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787787148.152404:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787148.152420:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503639168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.154116:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503638272:0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.154179:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503638784:0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.154243:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787148.154283:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503639296:0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.154321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787148.154342:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787148.154348:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503638912:0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.154373:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787148.154520:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503638400:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.154545:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638784 00000100:00100000:3.0:1787787148.154553:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638784 00000100:00100000:0.0:1787787148.154586:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503638912 00000100:00100000:0.0:1787787148.154590:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503638912 00000100:00100000:0.0:1787787148.154645:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787787148.154655:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503638912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.154663:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639296 00000100:00100000:3.0:1787787148.154666:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639296 00000100:00100000:3.0:1787787148.154682:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787787148.154688:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503638784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787148.154709:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503638912:12345-0@lo:400:kworker.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787148.154716:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787148.154719:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503638784:12345-0@lo:400:kworker.0 Request processed in 32us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787148.154724:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787787148.154734:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787787148.154740:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503639296:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787787148.154745:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403f0c0 x1874630503638912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787148.154756:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503638912:0@lo:400:kworker.0 00000100:00100000:3.0:1787787148.154763:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503639296:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00010000:00080000:0.0:1787787148.154766:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403f840 x1874630503638784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787148.154769:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787148.154775:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503638784:0@lo:400:kworker.0 00000100:00080000:3.0:1787787148.154787:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787148.154792:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787148.154794:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403cb40 x1874630503639296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787148.154802:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503639296:0@lo:400:kworker.0 00000001:02000400:2.0:1787787148.926064:0:11128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.52 00010000:00010000:1.0:1787787149.098705:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787150.123509:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787150.698467:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787150.698505:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503639424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787150.699037:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787150.699163:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639424 00000100:00100000:2.0:1787787150.699171:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639424 00000100:00100000:2.0:1787787150.699238:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787150.699250:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503639424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787150.699280:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787150.699325:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503639424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787150.699332:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787787150.699491:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787150.699687:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f7b480 x1874630503639424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787150.699709:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503639424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787150.699892:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787150.699904:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787150.699939:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787150.700053:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639552 00000100:00100000:3.0:1787787150.700058:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639552 00000100:00100000:3.0:1787787150.700105:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787150.700113:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503639552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787150.700126:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787150.700182:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503639552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787150.700189:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787787150.700291:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787150.700314:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403f840 x1874630503639552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787150.700327:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787151.027057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787151.027173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787151.027212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787151.027249:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698368 00000100:00100000:1.0:1787787151.027264:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698368 00000100:00100000:1.0:1787787151.027366:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698240 00000100:00100000:1.0:1787787151.027372:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698240 00000100:00100000:1.0:1787787151.027406:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:1.0:1787787151.027420:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484698368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787151.028270:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:2.0:1787787151.028294:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484698240:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787151.028386:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484698240:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787151.028395:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:1.0:1787787151.029149:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484698368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 137us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787151.029183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00080000:2.0:1787787151.031772:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787151.031785:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787151.040527:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698112 00000100:00100000:3.0:1787787151.040752:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698112 00000100:00100000:3.0:1787787151.040903:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 280 00000100:00100000:3.0:1787787151.040915:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484698112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787151.041028:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484698112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 115us (13989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787151.041036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 280 00010000:00010000:1.0:1787787151.145525:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787151.239720:0:11226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.52 00000001:00100000:2.0:1787787151.726330:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:2.0:1787787151.726344:0:9520:0:(genops.c:885:class_export_put()) final put ffff9870f4593000/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:0.0:1787787151.726456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4593000/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-OST0001 00000020:00000080:0.0:1787787151.726540:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f4591800 for lustre-OST0001 00000001:00100000:0.0:1787787151.728790:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:0.0:1787787151.728912:0:8436:0:(genops.c:885:class_export_put()) final put ffff9870fc310000/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:2.0:1787787151.729070:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc310000/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-OST0000 00000020:00000080:2.0:1787787151.729793:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc314000 for lustre-OST0000 00010000:00010000:3.0:1787787152.187457:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787152.746321:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503639680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787152.746438:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787152.747186:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639680 00000100:00100000:2.0:1787787152.747198:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639680 00000100:00100000:2.0:1787787152.747272:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787152.747284:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503639680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787152.747330:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787152.747396:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503639680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787152.747420:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787787152.747631:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503639680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787153.193508:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787153.257328:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503639808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787153.257454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787153.257562:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639808 00000100:00100000:1.0:1787787153.257572:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639808 00000100:00100000:1.0:1787787153.257630:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787153.257642:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503639808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787153.257689:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787787153.257743:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503639808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787153.257751:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787153.257801:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503639808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787153.258079:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503639936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787153.258115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787153.258233:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503639936 00000100:00100000:2.0:1787787153.258239:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503639936 00000100:00100000:2.0:1787787153.258312:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787153.258322:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503639936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787787153.258347:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787153.258389:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503639936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787153.258407:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787787153.258562:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787787153.258588:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5858b40 x1874630503639936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787153.258606:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503639936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787153.261946:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503640192:0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.262175:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503640064:0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.262289:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787153.262342:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503640576:0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.262372:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787153.262406:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503641088:0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.262432:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787153.262488:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640576 00000100:00100000:3.0:1787787153.262509:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640576 00000100:00100000:3.0:1787787153.262576:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641088 00000100:00100000:3.0:1787787153.262579:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641088 00000100:00100000:1.0:1787787153.262863:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640064 00000100:00100000:1.0:1787787153.262873:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640064 00000100:00100000:1.0:1787787153.262909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787787153.262921:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503640064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787153.262991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503640064:12345-0@lo:400:kworker.0 Request processed in 72us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787153.262998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787787153.263187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787153.263263:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787787153.263275:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503640576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.263315:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503640576:12345-0@lo:400:kworker.0 Request processed in 44us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787153.263322:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787787153.263335:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640192 00000100:00100000:3.0:1787787153.263339:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640192 00000100:00100000:3.0:1787787153.263357:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787787153.263364:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503641088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.263405:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503641088:12345-0@lo:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787153.263411:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787787153.263422:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787787153.263428:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503640192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.263460:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503640192:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787153.263466:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787787153.263506:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503640064:0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.263522:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503640576:0@lo:400:kworker.0 00000100:00100000:3.0:1787787153.263532:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503641088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.263681:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503640192:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.263692:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503640704:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.263730:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.263756:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503641216:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.263781:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.263816:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640704 00000100:00100000:0.0:1787787153.263819:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640704 00000100:00100000:0.0:1787787153.263845:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641216 00000100:00100000:0.0:1787787153.263848:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641216 00000100:00100000:0.0:1787787153.263868:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787153.263875:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.263916:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503640704:12345-0@lo:400:kworker.0 Request processed in 43us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.263923:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787153.263935:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787787153.263943:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff9592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.263982:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff9592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503641216:12345-0@lo:400:kworker.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.263989:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787787153.264014:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503640320:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.264526:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503640832:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264554:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.264570:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503641344:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.264625:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787787153.264633:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503640448:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264662:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.264683:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5859e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503640960:0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264703:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.264720:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503641472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787153.264742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787153.264772:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640320 00000100:00100000:0.0:1787787153.264776:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640320 00000100:00100000:0.0:1787787153.264804:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787787153.264811:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503640320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264847:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503640320:12345-0@lo:400:kworker.0 Request processed in 37us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.264855:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787787153.264873:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640832 00000100:00100000:0.0:1787787153.264877:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640832 00000100:00100000:0.0:1787787153.264915:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641344 00000100:00100000:0.0:1787787153.264918:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641344 00000100:00100000:0.0:1787787153.264938:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640960 00000100:00100000:0.0:1787787153.264940:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640960 00000100:00100000:0.0:1787787153.264956:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787153.264962:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503640832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.264996:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503640832:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.265002:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787153.265016:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787153.265038:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503641344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.265069:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503641344:12345-0@lo:400:kworker.0 Request processed in 48us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.265075:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787153.265088:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787153.265094:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff959680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503640960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.265120:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff959680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503640960:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.265126:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787153.265166:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641472 00000100:00100000:0.0:1787787153.265171:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641472 00000100:00100000:0.0:1787787153.265209:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787787153.265217:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503641472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787153.265233:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787153.265265:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503641472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.265272:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787787153.265314:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5859e00 x1874630503640960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787153.265327:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5859e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503640960:0@lo:400:kworker.0 00010000:00080000:0.0:1787787153.265338:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc10b30c0 x1874630503641472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787153.265353:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503641472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787153.265364:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503640320:0@lo:400:kworker.0 00010000:00080000:0.0:1787787153.265374:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585a580 x1874630503640832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787153.265382:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503640832:0@lo:400:kworker.0 00010000:00080000:0.0:1787787153.265390:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585b0c0 x1874630503641344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787153.265420:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503641344:0@lo:400:kworker.0 00010000:00080000:0.0:1787787153.265457:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f58592c0 x1874630503640704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787153.265466:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503640704:0@lo:400:kworker.0 00010000:00080000:0.0:1787787153.265476:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585bc00 x1874630503641216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787153.265483:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503641216:0@lo:400:kworker.0 00000100:00080000:0.0:1787787153.265521:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787153.265526:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787153.265529:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787153.265538:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787153.265561:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503640448 00000100:00100000:0.0:1787787153.265565:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503640448 00000100:00100000:0.0:1787787153.265595:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787153.265602:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503640448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787153.265642:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503640448:12345-0@lo:400:kworker.0 Request processed in 41us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787153.265647:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787153.265670:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503640448:0@lo:400:kworker.0 00000001:02000400:0.0:1787787153.439595:0:11323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.52 00010000:00010000:1.0:1787787154.217403:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787154.886020:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 19:32:33 EDT 2026 00010000:00010000:3.0:1787787155.241508:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787155.820431:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503641600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787155.821075:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787155.821183:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641600 00000100:00100000:3.0:1787787155.821191:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641600 00000100:00100000:3.0:1787787155.821247:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787155.821258:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503641600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787155.821288:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787155.821328:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503641600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787155.821334:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787787155.821364:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787155.821459:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc10b30c0 x1874630503641600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787155.821549:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503641600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787155.824685:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503641728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787155.824755:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787155.824823:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641728 00000100:00100000:3.0:1787787155.824831:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641728 00000100:00100000:3.0:1787787155.824887:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787787155.824896:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503641728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787155.824917:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787155.825031:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503641728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787155.825040:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787787155.825062:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787155.825089:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403cb40 x1874630503641728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787155.825126:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503641728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787156.145704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787156.145743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787156.145771:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787156.145800:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698496 00000100:00100000:1.0:1787787156.145809:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698496 00000100:00100000:1.0:1787787156.145860:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 282 00000100:00100000:1.0:1787787156.145871:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2394:x1874630484698496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787156.145940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2394:x1874630484698496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787156.145948:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 282 00000100:00100000:1.0:1787787156.145982:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698752 00000100:00100000:1.0:1787787156.145986:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698752 00000100:00100000:1.0:1787787156.146020:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698624 00000100:00100000:1.0:1787787156.146023:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698624 00000100:00100000:1.0:1787787156.146043:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 103 00000100:00100000:1.0:1787787156.146049:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484698752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787156.146079:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484698752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787156.146085:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 103 00000100:00100000:1.0:1787787156.146096:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00100000:1.0:1787787156.146113:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484698624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787156.146163:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484698624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787156.146169:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00080000:1.0:1787787156.146814:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787156.146820:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787787156.267505:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787157.289393:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787157.865843:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503641856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787157.865950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787157.866734:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641856 00000100:00100000:2.0:1787787157.866746:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641856 00000100:00100000:2.0:1787787157.867103:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787787157.867117:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503641856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787157.867191:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787157.867320:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503641856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 206us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787157.867328:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787157.867446:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503641856:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787158.313604:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787158.377598:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503641984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787158.377701:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787158.377763:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503642112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.377790:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503642496:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.377822:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787158.377843:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503643008:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.377869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787158.377899:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787787158.377907:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503642368:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.377922:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787158.377942:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787158.377957:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503642624:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.377969:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503642880:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.377992:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787158.378004:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787158.378016:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503643136:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.378033:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503643392:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.378045:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787158.378069:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787158.378074:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787787158.378083:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503642240:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.378111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787158.378131:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503642752:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.378186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787158.378385:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787158.378396:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503643520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787158.378429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787158.378485:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642112 00000100:00100000:0.0:1787787158.378494:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642112 00000100:00100000:1.0:1787787158.380036:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642496 00000100:00100000:1.0:1787787158.380053:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642496 00000100:00100000:3.0:1787787158.380089:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503643264:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.380130:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642624 00000100:00100000:1.0:1787787158.380149:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642624 00000100:00100000:3.0:1787787158.380182:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787158.380228:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503641984 00000100:00100000:3.0:1787787158.380232:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503641984 00000100:00100000:3.0:1787787158.380493:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787787158.380505:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503641984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787158.380549:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787158.380603:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503641984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.380610:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787787158.380640:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643008 00000100:00100000:1.0:1787787158.380692:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643136 00000100:00100000:1.0:1787787158.380706:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643136 00000100:00100000:1.0:1787787158.380724:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642240 00000100:00100000:1.0:1787787158.380729:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642240 00000100:00100000:3.0:1787787158.380730:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643008 00000100:00100000:1.0:1787787158.380747:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642752 00000100:00100000:1.0:1787787158.380751:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642752 00000100:00100000:3.0:1787787158.380774:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642880 00000100:00100000:1.0:1787787158.380775:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643264 00000100:00100000:3.0:1787787158.380779:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642880 00000100:00100000:1.0:1787787158.380780:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643264 00000100:00100000:3.0:1787787158.380807:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643392 00000100:00100000:3.0:1787787158.380813:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643392 00000100:00100000:1.0:1787787158.380814:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787787158.380827:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503642496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.380843:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787158.380852:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503643008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.380876:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503642496:12345-0@lo:400:kworker.0 Request processed in 52us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787158.380884:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787787158.380900:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503643008:12345-0@lo:400:kworker.0 Request processed in 48us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787158.380904:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787787158.380913:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787787158.380918:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503642624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.380930:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787158.380939:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503642880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381045:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503642880:12345-0@lo:400:kworker.0 Request processed in 108us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381051:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787158.381063:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787158.381069:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381098:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503643392:12345-0@lo:400:kworker.0 Request processed in 29us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381103:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787158.381124:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787787158.381130:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503643136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381185:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503643136:12345-0@lo:400:kworker.0 Request processed in 56us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381191:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787787158.381202:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787787158.381207:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381241:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503642240:12345-0@lo:400:kworker.0 Request processed in 34us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381318:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787787158.381330:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787787158.381336:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503642752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381445:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503642752:12345-0@lo:400:kworker.0 Request processed in 109us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381451:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787787158.381463:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787787158.381469:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503643264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381495:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503643264:12345-0@lo:400:kworker.0 Request processed in 27us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381501:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787787158.381560:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503642368 00000100:00100000:3.0:1787787158.381564:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503642368 00000100:00100000:3.0:1787787158.381582:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643520 00000100:00100000:3.0:1787787158.381584:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643520 00000100:00100000:3.0:1787787158.381593:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787787158.381598:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874630503642368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.381631:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874630503642368:12345-0@lo:400:kworker.0 Request processed in 33us (3692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787158.381637:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787787158.381659:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787158.381894:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503642624:12345-0@lo:400:kworker.0 Request processed in 979us (3901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787158.381903:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1787787158.381930:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787158.381936:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503643520:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787787158.381937:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787158.381943:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787158.381947:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787158.381991:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503642240:0@lo:400:kworker.0 00010000:00080000:1.0:1787787158.382009:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ede00 x1874630503642752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787158.382020:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503642752:0@lo:400:kworker.0 00000004:00000024:3.0:1787787158.382022:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00010000:00080000:1.0:1787787158.382037:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa27c00 x1874630503643264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787158.382061:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503643264:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.382081:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503643520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787158.382083:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503642624:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.382096:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787158.382100:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503643136:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.382189:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503642368:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.382192:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503643520:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787787158.382212:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ec000 x1874630503642880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787158.382222:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503642880:0@lo:400:kworker.0 00010000:00080000:1.0:1787787158.382236:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa27840 x1874630503643392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787158.382244:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503643392:0@lo:400:kworker.0 00000100:00100000:1.0:1787787158.382255:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503642496:0@lo:400:kworker.0 00010000:00080000:1.0:1787787158.382267:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ec780 x1874630503643008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787158.382273:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503643008:0@lo:400:kworker.0 00010000:00080000:1.0:1787787158.382285:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e92c0 x1874630503641984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787158.382308:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503641984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787158.382441:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787787158.382449:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503642112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787158.382515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503642112:12345-0@lo:400:kworker.0 Request processed in 67us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787158.382523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787787158.383356:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503642112:0@lo:400:kworker.0 00000100:00100000:3.0:1787787158.383791:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503643648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787158.383852:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787158.384675:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643648 00000100:00100000:0.0:1787787158.384686:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643648 00000100:00100000:0.0:1787787158.384768:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787158.384779:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503643648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787158.384808:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787158.388751:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503643648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3956us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787158.388771:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787787158.393763:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585a940 x1874630503643648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787158.393806:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503643648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787787159.347492:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787160.363186:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787160.938763:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787160.938804:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503643776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787160.938875:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787160.938941:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643776 00000100:00100000:1.0:1787787160.938949:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643776 00000100:00100000:1.0:1787787160.939004:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787160.939015:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503643776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787160.939062:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787160.939112:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503643776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787160.939120:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787787160.939173:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787160.939210:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403cb40 x1874630503643776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787160.939230:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503643776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787160.940159:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787160.940176:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503643904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787160.940223:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787160.940333:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503643904 00000100:00100000:0.0:1787787160.940341:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503643904 00000100:00100000:0.0:1787787160.940395:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787160.940404:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503643904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787160.940421:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787160.940462:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503643904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787160.940468:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787787160.940502:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff958780 x1874630503643904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787160.940517:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503643904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787160.940627:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787161.260895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787161.260945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787161.260975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787161.261007:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699136 00000100:00100000:1.0:1787787161.261017:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699136 00000100:00100000:1.0:1787787161.261076:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699008 00000100:00100000:1.0:1787787161.261079:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699008 00000100:00100000:1.0:1787787161.261106:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 111 00000100:00100000:1.0:1787787161.261115:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484699136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787161.261227:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484699136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787161.261235:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 111 00000100:00100000:1.0:1787787161.261265:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 112 00000100:00100000:1.0:1787787161.261273:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484699008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787161.261299:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484699008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787161.261304:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 112 00000100:00080000:1.0:1787787161.261322:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787161.261326:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787161.261790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484698880 00000100:00100000:2.0:1787787161.261795:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484698880 00000100:00100000:2.0:1787787161.261840:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 284 00000100:00100000:2.0:1787787161.261848:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2393:x1874630484698880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787161.261895:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2393:x1874630484698880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 48us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787161.261903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 284 00010000:00010000:3.0:1787787161.385405:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787162.410865:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787162.989766:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503644032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787162.989853:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787162.989956:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644032 00000100:00100000:1.0:1787787162.989963:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644032 00000100:00100000:1.0:1787787162.990017:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787162.990027:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503644032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787162.990076:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787162.996981:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503644032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6939us (7110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787162.996984:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503644032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787162.997001:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1787787163.433776:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787163.501947:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503644288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787163.502032:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787163.502122:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787163.502130:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503644160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787163.502178:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787163.502227:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644288 00000100:00100000:1.0:1787787163.502249:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644288 00000100:00100000:1.0:1787787163.502303:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644160 00000100:00100000:1.0:1787787163.502307:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644160 00000100:00100000:1.0:1787787163.502326:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787163.502335:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503644288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787163.502369:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787163.502418:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503644288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787163.502425:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787163.502441:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787163.502447:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503644160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787163.502458:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787163.502481:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503644160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787163.502487:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787787163.502506:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787787163.502547:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95b840 x1874630503644160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787163.502566:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503644160:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787787163.502578:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e61e00 x1874630503644288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787163.502588:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503644288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787163.507208:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503644416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787163.507323:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787163.510968:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644416 00000100:00100000:3.0:1787787163.511000:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644416 00000100:00100000:3.0:1787787163.511188:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787787163.511214:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503644416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787163.511276:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787787163.513289:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503644544:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787163.513481:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644544 00000100:00100000:2.0:1787787163.513491:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644544 00000100:00100000:2.0:1787787163.513543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787787163.513553:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503644544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503644544:12345-0@lo:400:kworker.0 Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.513624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787787163.513677:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503644544:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513736:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503644672:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787163.513802:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644672 00000100:00100000:2.0:1787787163.513806:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644672 00000100:00100000:2.0:1787787163.513836:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787163.513854:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503644672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513894:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503644672:12345-0@lo:400:kworker.0 Request processed in 42us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.513901:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787163.513931:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503644672:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513961:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787163.513967:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503644800:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.513994:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787163.514021:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644800 00000100:00100000:2.0:1787787163.514025:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644800 00000100:00100000:2.0:1787787163.514055:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787787163.514061:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503644800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787163.514244:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503644416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3024us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787163.514260:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787163.514706:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503644416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787163.516412:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503644800:12345-0@lo:400:kworker.0 Request processed in 2339us (2406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.516428:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787787163.516534:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787163.516536:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503644800:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.516561:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503644928:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.516609:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787163.516654:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503644928 00000100:00100000:2.0:1787787163.516663:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503644928 00000100:00100000:2.0:1787787163.516716:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787787163.516724:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5859e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503644928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.516766:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5859e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503644928:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.516772:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787787163.516808:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503644928:0@lo:400:kworker.0 00000100:00080000:2.0:1787787163.516842:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787163.516877:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503645056:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.516905:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787163.516948:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645056 00000100:00100000:2.0:1787787163.516953:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645056 00000100:00100000:2.0:1787787163.516992:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787787163.517002:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5858f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503645056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.517056:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5858f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503645056:12345-0@lo:400:kworker.0 Request processed in 57us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.517064:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787787163.518280:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787163.518441:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503645440:0@lo:400:kworker.0 00000100:00100000:3.0:1787787163.518522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787163.518581:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787163.518587:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503645568:0@lo:400:kworker.0 00000100:00100000:3.0:1787787163.518629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787163.518829:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503645184:0@lo:400:kworker.0 00000100:00100000:1.0:1787787163.518874:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787163.518907:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787163.518915:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503645312:0@lo:400:kworker.0 00000100:00100000:1.0:1787787163.518940:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787163.518979:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645184 00000100:00100000:1.0:1787787163.518989:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645184 00000100:00100000:1.0:1787787163.519048:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645312 00000100:00100000:1.0:1787787163.519052:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645312 00000100:00100000:1.0:1787787163.519078:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787163.519089:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503645184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787163.519183:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503645184:12345-0@lo:400:kworker.0 Request processed in 95us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787163.519191:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787163.519223:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787163.519230:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503645312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787163.519260:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503645312:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787163.519266:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787787163.519287:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787163.519319:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa25a40 x1874630503645312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787163.519345:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503645312:0@lo:400:kworker.0 00010000:00080000:1.0:1787787163.519358:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa270c0 x1874630503645184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787163.519366:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503645184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.520288:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645440 00000100:00100000:2.0:1787787163.520308:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645440 00000100:00100000:2.0:1787787163.520398:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645568 00000100:00100000:2.0:1787787163.520402:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645568 00000100:00100000:2.0:1787787163.520426:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787787163.520438:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503645440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.520572:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503645440:12345-0@lo:400:kworker.0 Request processed in 134us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.520581:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787787163.520601:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787787163.520607:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503645568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.520638:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503645568:12345-0@lo:400:kworker.0 Request processed in 31us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787163.520644:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1787787163.520703:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f58583c0 x1874630503645056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787163.520741:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503645056:0@lo:400:kworker.0 00010000:00080000:2.0:1787787163.520797:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa26940 x1874630503645568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787163.520808:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503645568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787163.520821:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503645440:0@lo:400:kworker.0 00000100:00080000:3.0:1787787163.522811:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787163.522822:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787164.457638:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787165.481441:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787166.057892:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787166.057916:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f59412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503645696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787166.057989:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787166.058050:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645696 00000100:00100000:1.0:1787787166.058057:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645696 00000100:00100000:1.0:1787787166.058108:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787166.058118:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503645696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787166.058175:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787166.058228:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503645696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787166.058235:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787787166.058255:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787166.058432:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f59412c0 x1874630503645696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787166.058452:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f59412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503645696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787166.063206:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503645824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787166.063286:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787166.063714:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645824 00000100:00100000:1.0:1787787166.063722:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645824 00000100:00100000:1.0:1787787166.063792:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787166.063802:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f58583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503645824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787166.063837:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787166.063889:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f58583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503645824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787166.063896:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787787166.064340:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787166.064376:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5943840 x1874630503645824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787166.064396:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503645824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787166.382221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787166.382342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787166.382371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787166.382433:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699392 00000100:00100000:3.0:1787787166.382444:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699392 00000100:00080000:1.0:1787787166.382506:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787166.382519:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699520 00000100:00100000:3.0:1787787166.382523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699520 00000100:00100000:0.0:1787787166.382621:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699264 00000100:00100000:0.0:1787787166.382626:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699264 00000100:00100000:0.0:1787787166.382659:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 286 00000100:00100000:0.0:1787787166.382677:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484699264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787166.382745:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484699264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787166.382768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 286 00000100:00100000:2.0:1787787166.383053:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:2.0:1787787166.383065:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f59412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484699392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787166.383107:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f59412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484699392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787166.383114:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:2.0:1787787166.392477:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:2.0:1787787166.392499:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484699520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787166.393640:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484699520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1145us (11262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787166.393650:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00080000:1.0:1787787166.398737:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787787166.506172:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787167.533001:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787168.106400:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787168.106425:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503645952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787168.106495:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787168.106643:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503645952 00000100:00100000:1.0:1787787168.106651:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503645952 00000100:00100000:1.0:1787787168.106699:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787787168.106708:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503645952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787168.106742:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787168.106798:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503645952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787168.106805:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787787168.106951:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503645952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787168.557614:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787168.617539:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787168.617562:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503646080:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.617797:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503646208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787168.617858:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787168.617933:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787168.617939:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503646336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787168.617967:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787168.618001:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646336 00000100:00100000:0.0:1787787168.618008:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646336 00000100:00100000:3.0:1787787168.618037:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646208 00000100:00100000:3.0:1787787168.618042:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646208 00000100:00100000:0.0:1787787168.618060:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787787168.618068:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787787168.618069:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503646336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787168.618073:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503646208:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1787787168.618108:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787787168.618109:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787787168.618276:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787168.618327:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503646464:0@lo:400:kworker.0 00000100:00100000:1.0:1787787168.618355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787168.618393:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787168.618399:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503646592:0@lo:400:kworker.0 00000100:00100000:1.0:1787787168.618422:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787168.621295:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503646208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3210us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.621391:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787787168.621483:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787168.621508:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503646848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787168.621581:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787168.621625:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787168.621634:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503646720:0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.621659:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787168.621694:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646464 00000100:00100000:3.0:1787787168.621702:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646464 00000100:00100000:3.0:1787787168.621740:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646592 00000100:00100000:3.0:1787787168.621743:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646592 00000100:00100000:3.0:1787787168.621755:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646720 00000100:00100000:3.0:1787787168.621757:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646720 00000100:00100000:3.0:1787787168.621779:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787787168.621786:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503646464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.621860:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503646464:12345-0@lo:400:kworker.0 Request processed in 73us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.621867:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787787168.621880:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787787168.621886:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503646592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.621916:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503646592:12345-0@lo:400:kworker.0 Request processed in 31us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.621922:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787787168.621933:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787787168.621938:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503646720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.621968:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503646720:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.621973:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1787787168.622971:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787168.623051:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503646720:0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.623136:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646080 00000100:00100000:3.0:1787787168.623156:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646080 00000100:00100000:3.0:1787787168.623212:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787787168.623220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503646080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.623281:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503646080:12345-0@lo:400:kworker.0 Request processed in 63us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.623287:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787787168.623423:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646848 00000100:00100000:3.0:1787787168.623429:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646848 00000100:00100000:3.0:1787787168.623460:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787168.623465:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503646848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787168.623498:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787168.623539:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503646848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.623546:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787787168.623561:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787168.623737:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503646336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5667us (5766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787168.623744:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787787168.623806:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503646592:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.623820:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503646464:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.623830:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503646080:0@lo:400:kworker.0 00010000:00080000:0.0:1787787168.623880:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585ad00 x1874630503646848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787168.623910:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503646848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787168.624128:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503646976:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624290:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503647104:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624330:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787168.624378:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787168.624384:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503647232:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624408:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787168.624446:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503647360:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624477:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787168.624509:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647360 00000100:00100000:0.0:1787787168.624514:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647360 00000100:00100000:0.0:1787787168.624557:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787787168.624565:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503647360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624735:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503647360:12345-0@lo:400:kworker.0 Request processed in 170us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787168.624742:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787787168.624762:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787168.624785:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503647360:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624817:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787168.624824:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503647488:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624849:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787168.624872:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647488 00000100:00100000:0.0:1787787168.624876:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647488 00000100:00100000:0.0:1787787168.624906:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787787168.624912:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503647488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.624958:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503647488:12345-0@lo:400:kworker.0 Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787168.624964:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1787787168.624978:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787787168.624995:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0e580 x1874630503647488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787168.625005:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503647488:0@lo:400:kworker.0 00000100:00100000:0.0:1787787168.625040:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647104 00000100:00100000:0.0:1787787168.625043:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647104 00000100:00100000:0.0:1787787168.625072:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647232 00000100:00100000:0.0:1787787168.625075:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647232 00000100:00100000:0.0:1787787168.625106:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787168.625114:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503647104:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787787168.625134:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95a940 x1874630503646336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787168.625164:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503646336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787168.625351:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787787168.625361:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503647232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.629452:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503646208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787168.629896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787168.629970:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787168.630410:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503646976 00000100:00100000:3.0:1787787168.630419:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503646976 00000100:00100000:3.0:1787787168.630488:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787787168.630497:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503646976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787168.630565:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503646976:12345-0@lo:400:kworker.0 Request processed in 69us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787168.630572:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787787168.631292:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503647104:12345-0@lo:400:kworker.0 Request processed in 6174us (6956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787168.631304:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787787168.631392:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787787168.631428:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5a40 x1874630503646976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787168.631442:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503646976:0@lo:400:kworker.0 00010000:00080000:3.0:1787787168.631576:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0f480 x1874630503647104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787168.631587:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503647104:0@lo:400:kworker.0 00000100:00100000:2.0:1787787168.632326:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503647232:12345-0@lo:400:kworker.0 Request processed in 6963us (7912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787168.632338:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787787168.635311:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0f840 x1874630503647232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787168.635332:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503647232:0@lo:400:kworker.0 00010000:00010000:2.0:1787787169.577727:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787169.622260:0:12000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:32:48 (1787787168) === 00000100:00100000:0.0:1787787170.002265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787170.002379:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699648 00000100:00100000:1.0:1787787170.002405:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699648 00000100:00100000:1.0:1787787170.002469:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 288 00000100:00100000:1.0:1787787170.002481:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:8709:x1874630484699648:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787170.002500:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787170.002519:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8023 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787170.002565:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8023 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787170.002578:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8023 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787170.002588:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5800, rc 0) 00000100:00100000:1.0:1787787170.002658:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8709:x1874630484699648:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 179us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787170.002664:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 288 00000100:00100000:0.0:1787787170.012889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.013458:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699776 00000100:00100000:2.0:1787787170.013469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699776 00000100:00100000:2.0:1787787170.013581:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 289 00000100:00100000:2.0:1787787170.013591:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8709:x1874630484699776:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787787170.013768:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8709:x1874630484699776:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 177us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787170.013776:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 289 00000100:00100000:0.0:1787787170.034203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.034494:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484699904 00000100:00100000:3.0:1787787170.034504:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484699904 00000100:00100000:3.0:1787787170.034568:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 290 00000100:00100000:3.0:1787787170.034578:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8709:x1874630484699904:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787787170.034737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8709:x1874630484699904:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 160us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.034752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 290 00000100:00100000:0.0:1787787170.041474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.045610:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700032 00000100:00100000:2.0:1787787170.045626:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700032 00000100:00100000:3.0:1787787170.048047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 291 00000100:00100000:3.0:1787787170.048063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8713:x1874630484700032:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787170.048288:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8713:x1874630484700032:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 227us (6823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.048297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 291 00000100:00100000:0.0:1787787170.092771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787170.092962:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700160 00000100:00100000:1.0:1787787170.092975:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700160 00000100:00100000:1.0:1787787170.093051:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 292 00000100:00100000:1.0:1787787170.093062:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8713:x1874630484700160:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787170.093382:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8713:x1874630484700160:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 321us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787170.093392:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 292 00000100:00100000:0.0:1787787170.100570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.100711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700288 00000100:00100000:2.0:1787787170.100730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700288 00000100:00100000:2.0:1787787170.100811:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 293 00000100:00100000:2.0:1787787170.100822:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8713:x1874630484700288:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787170.102044:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8713:x1874630484700288:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 1216us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787170.102506:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 293 00000100:00100000:0.0:1787787170.108758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.109175:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700416 00000100:00100000:3.0:1787787170.109187:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700416 00000100:00100000:3.0:1787787170.109256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 294 00000100:00100000:3.0:1787787170.109267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:8709:x1874630484700416:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787170.109284:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787170.109303:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8054 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787170.109336:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8054 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787170.109348:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8054 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787170.109357:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6000, rc 0) 00000100:00100000:3.0:1787787170.109411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:8709:x1874630484700416:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 146us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.109419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 294 00000100:00100000:0.0:1787787170.112678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.114286:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700544 00000100:00100000:3.0:1787787170.114301:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700544 00000100:00100000:3.0:1787787170.114376:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 295 00000100:00100000:3.0:1787787170.114386:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:8709:x1874630484700544:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787787170.114414:0:6522:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787787170.114598:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787787170.114603:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787787170.114606:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787787170.114609:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787787170.114611:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787787170.123022:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:8709:x1874630484700544:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 8626us (10345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.123038:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 295 00000100:00100000:0.0:1787787170.130172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787170.131003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700672 00000100:00100000:1.0:1787787170.131013:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700672 00000100:00100000:1.0:1787787170.131090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 296 00000100:00100000:1.0:1787787170.131100:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:8709:x1874630484700672:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787170.131133:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787170.131178:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c805b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787170.131208:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787170.131220:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787170.131228:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5400, rc 0) 00000100:00100000:1.0:1787787170.131298:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8709:x1874630484700672:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 200us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787170.131306:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 296 00000100:00100000:0.0:1787787170.133684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.133789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700800 00000100:00100000:3.0:1787787170.133799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700800 00000100:00100000:3.0:1787787170.133852:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 297 00000100:00100000:3.0:1787787170.133861:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8709:x1874630484700800:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787787170.134245:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8709:x1874630484700800:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 383us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.134254:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 297 00000100:00100000:2.0:1787787170.139406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787170.145590:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484700928 00000100:00100000:0.0:1787787170.145604:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484700928 00000100:00100000:0.0:1787787170.145714:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 298 00000100:00100000:0.0:1787787170.145725:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8709:x1874630484700928:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787787170.145890:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8709:x1874630484700928:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 166us (6493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787170.145898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 298 00000100:00100000:0.0:1787787170.156848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.157317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701056 00000100:00100000:3.0:1787787170.157328:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701056 00000100:00100000:3.0:1787787170.157390:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 299 00000100:00100000:3.0:1787787170.157400:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8716:x1874630484701056:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787170.157583:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8716:x1874630484701056:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 183us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.157591:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 299 00000100:00100000:3.0:1787787170.162080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.162433:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701184 00000100:00100000:2.0:1787787170.162442:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701184 00000100:00100000:2.0:1787787170.162500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 300 00000100:00100000:2.0:1787787170.162509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8716:x1874630484701184:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787170.162663:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:8716:x1874630484701184:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 154us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787170.162671:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 300 00000100:00100000:2.0:1787787170.169525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.169565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.169597:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.169843:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701312 00000100:00100000:3.0:1787787170.169855:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701312 00000100:00100000:3.0:1787787170.169901:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701568 00000100:00100000:3.0:1787787170.169905:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701568 00000100:00100000:3.0:1787787170.169949:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701696 00000100:00100000:3.0:1787787170.169953:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701696 00000100:00100000:3.0:1787787170.169973:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:3.0:1787787170.169983:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5858b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484701568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787170.170060:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5858b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484701568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.170078:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:3.0:1787787170.170095:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:3.0:1787787170.170102:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484701696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787170.170176:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484701696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.170183:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:3.0:1787787170.170197:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:3.0:1787787170.170201:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1874630484701312:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787787170.170225:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 12b28a37-797d-4b20-85b7-441f77f74f4f@192.168.204.31@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1787787170.170258:0:6529:0:(genops.c:1385:class_connect()) connect: client 12b28a37-797d-4b20-85b7-441f77f74f4f, cookie 0x11620bc3f30a8df8 00000004:00100000:3.0:1787787170.170285:0:6529:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787787170.170395:0:6529:0:(import.c:65:import_set_state_nolock()) ffff9870fc310800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787170.170424:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2390:x1874630484701312:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 220us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.170446:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00080000:1.0:1787787170.171098:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787170.171105:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787170.171482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.171606:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701824 00000100:00100000:3.0:1787787170.171626:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701824 00000100:00100000:3.0:1787787170.171665:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:3.0:1787787170.171671:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1874630484701824:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787787170.171696:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 12b28a37-797d-4b20-85b7-441f77f74f4f@192.168.204.31@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1787787170.171725:0:6529:0:(genops.c:1385:class_connect()) connect: client 12b28a37-797d-4b20-85b7-441f77f74f4f, cookie 0x11620bc3f30a8dff 00000004:00100000:3.0:1787787170.171745:0:6529:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787787170.171834:0:6529:0:(import.c:65:import_set_state_nolock()) ffff9870fc311000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787170.171888:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2390:x1874630484701824:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 215us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.171897:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:3.0:1787787170.186751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.186794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787170.186930:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701440 00000100:00100000:1.0:1787787170.186941:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701440 00000100:00100000:1.0:1787787170.187018:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702080 00000100:00100000:1.0:1787787170.187021:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702080 00000100:00100000:1.0:1787787170.187045:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:1.0:1787787170.187054:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+7:0:x1874630484701440:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787787170.187106:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787787170.187239:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+7:0:x1874630484701440:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 185us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787170.187247:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:1.0:1787787170.187265:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787170.187272:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702080:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787787170.187437:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787787170.187465:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702080:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 192us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787170.187471:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00080000:3.0:1787787170.188611:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787170.194329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787170.194369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787170.194610:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484701952 00000100:00100000:0.0:1787787170.194619:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484701952 00000100:00100000:0.0:1787787170.194694:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702208 00000100:00100000:0.0:1787787170.194698:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702208 00000100:00100000:0.0:1787787170.194724:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787170.194732:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f58592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+6:0:x1874630484701952:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787170.194773:0:7753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787170.194859:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f58592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+6:0:x1874630484701952:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 127us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787170.194867:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787170.194885:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:0.0:1787787170.194892:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702208:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787787170.194924:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702208:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 33us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787170.194946:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00080000:3.0:1787787170.195084:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787170.197281:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787170.197336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787170.197368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787170.197683:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702592 00000100:00100000:1.0:1787787170.197695:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702592 00000100:00100000:1.0:1787787170.197766:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:1.0:1787787170.197777:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702592:12345-192.168.204.31@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787787170.197869:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702592:12345-192.168.204.31@tcp:900:mount.lustre.0 Request processed in 94us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787170.197878:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:2.0:1787787170.199599:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702336 00000100:00100000:2.0:1787787170.199613:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702336 00000100:00100000:2.0:1787787170.199693:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702464 00000100:00100000:2.0:1787787170.199697:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702464 00000100:00100000:2.0:1787787170.199732:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1787787170.199740:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1874630484702336:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787170.199771:0:8443:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 12b28a37-797d-4b20-85b7-441f77f74f4f@192.168.204.31@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1787787170.199803:0:8443:0:(genops.c:1385:class_connect()) connect: client 12b28a37-797d-4b20-85b7-441f77f74f4f, cookie 0x11620bc3f30a8e06 00002000:00100000:2.0:1787787170.199814:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12b28a37-797d-4b20-85b7-441f77f74f4f/ffff986fc341a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787170.199832:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787170.199908:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787787170.199961:0:8443:0:(import.c:65:import_set_state_nolock()) ffff986fc3419000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787170.200033:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2390:x1874630484702336:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 293us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787170.200042:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1787787170.200059:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:2.0:1787787170.200063:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1874630484702464:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787170.200098:0:8443:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 12b28a37-797d-4b20-85b7-441f77f74f4f@192.168.204.31@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1787787170.201749:0:8443:0:(genops.c:1385:class_connect()) connect: client 12b28a37-797d-4b20-85b7-441f77f74f4f, cookie 0x11620bc3f30a8e0d 00002000:00100000:2.0:1787787170.201770:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12b28a37-797d-4b20-85b7-441f77f74f4f/ffff986fc341d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787170.201791:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787170.201867:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787170.201902:0:8443:0:(import.c:65:import_set_state_nolock()) ffff986fc341f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787170.201973:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2390:x1874630484702464:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 1906us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787170.201983:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1787787170.202158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787170.204123:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702720 00000100:00100000:3.0:1787787170.204276:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702720 00000100:00100000:3.0:1787787170.204416:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1787787170.204591:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702720:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787787170.204695:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787787170.204786:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:8709:x1874630484702720:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 361us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787170.204794:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00010000:00010000:1.0:1787787170.601531:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787171.180788:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503647616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787171.180867:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787171.181003:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647616 00000100:00100000:3.0:1787787171.181011:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647616 00000100:00100000:3.0:1787787171.181088:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787171.181099:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503647616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787171.181123:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787171.181215:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503647616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787171.181222:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787787171.181302:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787171.181340:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa243c0 x1874630503647616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787171.181359:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503647616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787171.186122:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787171.186172:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503647744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787171.186244:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787171.186462:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647744 00000100:00100000:1.0:1787787171.186471:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647744 00000100:00100000:1.0:1787787171.186575:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787171.186585:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503647744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787171.186609:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787171.186660:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503647744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787171.186667:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787787171.194315:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7840 x1874630503647744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787171.194347:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503647744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787787171.198717:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787787171.627269:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787172.649485:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787173.230602:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503647872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787173.230704:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787173.230801:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503647872 00000100:00100000:1.0:1787787173.230810:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503647872 00000100:00100000:1.0:1787787173.230868:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787173.230877:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503647872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787173.230925:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787173.230985:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503647872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787173.230993:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787173.231075:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503647872:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787173.674340:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787173.737494:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503648128:0@lo:400:kworker.0 00000100:00100000:1.0:1787787173.737597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787173.737666:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503648640:0@lo:400:kworker.0 00000100:00100000:1.0:1787787173.737692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787173.737719:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503649152:0@lo:400:kworker.0 00000100:00100000:1.0:1787787173.737742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787173.737773:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787787173.737779:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503648000:0@lo:400:kworker.0 00000100:00100000:1.0:1787787173.737827:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787173.737852:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503648512:0@lo:400:kworker.0 00000100:00100000:1.0:1787787173.738079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787173.738172:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503649024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787173.738198:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787173.738266:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503649536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787173.738304:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787173.738330:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787173.738335:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503649664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787173.738363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787173.738418:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649536 00000100:00100000:0.0:1787787173.738427:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649536 00000100:00100000:0.0:1787787173.738492:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787787173.738503:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503649536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787173.738542:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787173.738592:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503649536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787173.738606:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787787173.738635:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787787173.738667:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585a1c0 x1874630503649536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787173.738689:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503649536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787173.742608:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503648256:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.742719:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.742775:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503648768:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.742805:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.742827:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503649280:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.742851:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.742870:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503649792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787173.743159:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648128 00000100:00100000:2.0:1787787173.743172:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648128 00000100:00100000:2.0:1787787173.743243:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648640 00000100:00100000:2.0:1787787173.743247:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648640 00000100:00100000:2.0:1787787173.743278:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649152 00000100:00100000:2.0:1787787173.743281:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649152 00000100:00100000:2.0:1787787173.743297:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648512 00000100:00100000:2.0:1787787173.743300:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648512 00000100:00100000:2.0:1787787173.743315:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649024 00000100:00100000:2.0:1787787173.743319:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649024 00000100:00100000:2.0:1787787173.743340:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787787173.743351:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503648128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787173.743453:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503648128:12345-0@lo:400:kworker.0 Request processed in 104us (5857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787173.743462:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787787173.743482:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787787173.743647:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.743682:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787787173.743691:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503648384:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.743741:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.743757:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503648896:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.743783:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.743804:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503649408:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.743824:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787173.743870:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648384 00000100:00100000:3.0:1787787173.743875:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648384 00000100:00100000:2.0:1787787173.743979:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503648640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744250:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787787173.744260:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503649152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744303:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503649152:12345-0@lo:400:kworker.0 Request processed in 46us (6560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744322:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787787173.744339:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787787173.744345:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503648512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744394:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503648512:12345-0@lo:400:kworker.0 Request processed in 50us (6315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744401:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787787173.744414:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787787173.744420:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503649024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744450:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503649024:12345-0@lo:400:kworker.0 Request processed in 31us (6251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744455:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787787173.744466:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787787173.744472:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503648384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744513:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503648384:12345-0@lo:400:kworker.0 Request processed in 41us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744519:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787787173.744542:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648768 00000100:00100000:3.0:1787787173.744547:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648768 00000100:00100000:3.0:1787787173.744570:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649280 00000100:00100000:3.0:1787787173.744573:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649280 00000100:00100000:3.0:1787787173.744594:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648896 00000100:00100000:3.0:1787787173.744597:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648896 00000100:00100000:3.0:1787787173.744610:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649408 00000100:00100000:3.0:1787787173.744612:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649408 00000100:00100000:3.0:1787787173.744628:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787173.744634:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503648768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744677:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503648768:12345-0@lo:400:kworker.0 Request processed in 43us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744683:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787173.744696:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787173.744702:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503649280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744730:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503649280:12345-0@lo:400:kworker.0 Request processed in 28us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744735:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787173.744745:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787173.744750:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503648896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744772:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503648896:12345-0@lo:400:kworker.0 Request processed in 23us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744778:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787173.744788:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787173.744793:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503649408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.744819:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503649408:12345-0@lo:400:kworker.0 Request processed in 26us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744825:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787173.744847:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649792 00000100:00100000:3.0:1787787173.744852:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649792 00000100:00100000:3.0:1787787173.744881:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787173.744889:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503649792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787173.744922:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787173.744960:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503649792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787173.744976:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787173.745046:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503648384:0@lo:400:kworker.0 00000100:00100000:2.0:1787787173.745171:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503648640:12345-0@lo:400:kworker.0 Request processed in 1195us (7477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787173.745179:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787787173.745222:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503648512:0@lo:400:kworker.0 00000100:00100000:2.0:1787787173.745236:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503649024:0@lo:400:kworker.0 00000100:00100000:2.0:1787787173.745250:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503648128:0@lo:400:kworker.0 00010000:00080000:2.0:1787787173.745267:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a75e00 x1874630503648640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787173.745280:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503648640:0@lo:400:kworker.0 00010000:00080000:2.0:1787787173.745294:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a74780 x1874630503649152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787173.745303:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503649152:0@lo:400:kworker.0 00010000:00080000:3.0:1787787173.745563:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a74b40 x1874630503648896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787173.745575:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503648896:0@lo:400:kworker.0 00010000:00080000:3.0:1787787173.745587:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a743c0 x1874630503649408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787173.745597:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503649408:0@lo:400:kworker.0 00010000:00080000:3.0:1787787173.745609:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a761c0 x1874630503648768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787173.745619:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503648768:0@lo:400:kworker.0 00010000:00080000:3.0:1787787173.745631:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a76940 x1874630503649280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787173.745638:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503649280:0@lo:400:kworker.0 00010000:00080000:3.0:1787787173.745646:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0c780 x1874630503649792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787173.745661:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503649792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787173.745766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648000 00000100:00100000:1.0:1787787173.745772:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648000 00000100:00100000:2.0:1787787173.746008:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649664 00000100:00100000:2.0:1787787173.746117:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649664 00000100:00100000:2.0:1787787173.746173:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503648256 00000100:00100000:2.0:1787787173.746177:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503648256 00000100:00100000:2.0:1787787173.746193:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787787173.746201:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503649664:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787173.746236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787787173.746245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503648000:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1787787173.746254:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:0.0:1787787173.746451:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787173.746460:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787173.746465:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787173.746468:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787173.746593:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503648000:12345-0@lo:400:kworker.0 Request processed in 349us (8764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787173.746602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787787173.746647:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503649664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 445us (8282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787173.746655:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787787173.746669:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787787173.746675:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503648256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787173.746722:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503648256:12345-0@lo:400:kworker.0 Request processed in 47us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787173.746729:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787787173.746814:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503648000:0@lo:400:kworker.0 00000100:00100000:3.0:1787787173.746886:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503649664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787173.747268:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503648256:0@lo:400:kworker.0 00010000:00010000:1.0:1787787174.699317:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787175.606509:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787175.606606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787175.606652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787175.606695:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703104 00000100:00100000:1.0:1787787175.606697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787175.606710:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703104 00000100:00100000:1.0:1787787175.606720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787175.606738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787175.606763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787175.606789:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703360 00000100:00100000:1.0:1787787175.606793:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703360 00000100:00100000:2.0:1787787175.606795:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702976 00000100:00100000:2.0:1787787175.606797:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702976 00000100:00100000:2.0:1787787175.606812:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703232 00000100:00100000:2.0:1787787175.606815:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703232 00000100:00100000:1.0:1787787175.606821:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:2.0:1787787175.606832:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:1.0:1787787175.606833:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484703104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787175.606837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484702976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787175.606935:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484703104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787175.606944:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:1.0:1787787175.606977:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:1.0:1787787175.606984:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787175.607010:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787175.607034:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484702976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 196us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787175.607041:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:1.0:1787787175.607045:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:2.0:1787787175.607055:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:2.0:1787787175.607060:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787175.607085:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787175.607091:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:2.0:1787787175.607128:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703616 00000100:00100000:2.0:1787787175.607166:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703616 00000100:00100000:2.0:1787787175.607199:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703488 00000100:00100000:2.0:1787787175.607202:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703488 00000100:00100000:2.0:1787787175.607223:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:2.0:1787787175.607229:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787175.607258:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787175.607264:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:2.0:1787787175.607276:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:2.0:1787787175.607282:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787175.607306:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484703488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787175.607313:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00080000:0.0:1787787175.607595:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787175.607601:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787175.607604:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787175.607606:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787175.608339:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484702848 00000100:00100000:3.0:1787787175.608350:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484702848 00000100:00100000:3.0:1787787175.608405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 302 00000100:00100000:3.0:1787787175.608413:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484702848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787175.608526:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484702848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 113us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787175.608534:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 302 00010000:00010000:2.0:1787787175.721420:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787787175.789538:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00100000:0.0:1787787175.796627:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00100000:1.0:1787787175.796736:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00100000:2.0:1787787175.796813:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000100:00100000:3.0:1787787176.298314:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503649920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787176.298392:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787176.298464:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503649920 00000100:00100000:3.0:1787787176.298472:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503649920 00000100:00100000:3.0:1787787176.298540:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787176.298550:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503649920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787176.298596:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787176.298789:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503649920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 239us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787176.298797:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787787176.298833:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a0b840 x1874630503649920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787176.298851:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503649920:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787787176.298927:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787176.298980:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4140b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503650048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787176.299007:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787176.299070:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650048 00000100:00100000:0.0:1787787176.299086:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650048 00000100:00100000:0.0:1787787176.299162:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787787176.299171:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503650048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787176.299184:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787787176.299198:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787176.299470:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4140b40 x1874630503650048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787176.299471:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503650048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 297us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787176.299488:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787787176.299496:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4140b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503650048:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787787176.686830:0:12193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787787176.745342:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787177.771847:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787178.345797:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4141e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503650176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787178.345877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.349041:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650176 00000100:00100000:2.0:1787787178.349057:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650176 00000100:00100000:2.0:1787787178.349155:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787787178.349166:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503650176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787178.349217:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787178.349304:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503650176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.349311:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787787178.349850:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4141e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503650176:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787787178.793345:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787178.858303:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787178.858336:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503650304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787178.858403:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859551:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503650432:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859603:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859635:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503650944:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859661:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859680:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503651456:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859702:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859725:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787787178.859731:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503650816:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859755:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859772:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503651328:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859795:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859815:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503651840:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859835:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859860:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503650560:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.859913:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.859936:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503651072:0@lo:400:kworker.0 00000100:00100000:1.0:1787787178.860058:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650304 00000100:00100000:1.0:1787787178.860066:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650304 00000100:00100000:1.0:1787787178.861200:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650816 00000100:00100000:1.0:1787787178.861208:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650816 00000100:00100000:1.0:1787787178.861229:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787178.861237:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503650304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787178.861275:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787787178.865213:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787178.865235:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503651968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787178.866198:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503650688:0@lo:400:kworker.0 00000100:00100000:1.0:1787787178.876353:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503650304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15104us (17938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787178.876369:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787178.876410:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787787178.876423:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503650816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787178.876487:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503650816:12345-0@lo:400:kworker.0 Request processed in 69us (16731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787178.876493:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787178.881509:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787178.881625:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503650816:0@lo:400:kworker.0 00000100:00100000:0.0:1787787178.881652:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503650304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787178.881931:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651968 00000100:00100000:1.0:1787787178.881939:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651968 00000100:00100000:1.0:1787787178.882014:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787178.882023:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503651968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787178.882054:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787178.882114:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503651968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787178.882121:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787787178.882484:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787787178.882517:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0e940 x1874630503651968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787178.882535:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503651968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787178.885807:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.885858:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503651200:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.885910:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.885943:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503651712:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.885976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.886013:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787178.886020:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503652096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787178.886062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.886119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650432 00000100:00100000:2.0:1787787178.886127:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650432 00000100:00100000:2.0:1787787178.886205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787787178.886216:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503650432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886273:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503650432:12345-0@lo:400:kworker.0 Request processed in 59us (26669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886280:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787787178.886316:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650944 00000100:00100000:2.0:1787787178.886320:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650944 00000100:00100000:2.0:1787787178.886348:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651456 00000100:00100000:2.0:1787787178.886351:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651456 00000100:00100000:2.0:1787787178.886363:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650560 00000100:00100000:2.0:1787787178.886366:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650560 00000100:00100000:2.0:1787787178.886378:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503650688 00000100:00100000:2.0:1787787178.886380:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503650688 00000100:00100000:2.0:1787787178.886392:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787787178.886399:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503650944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886434:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503650944:12345-0@lo:400:kworker.0 Request processed in 35us (26772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886440:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787787178.886452:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787178.886458:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503651456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886486:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503651456:12345-0@lo:400:kworker.0 Request processed in 28us (26783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886492:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787178.886503:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787787178.886509:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503650560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886547:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503650560:12345-0@lo:400:kworker.0 Request processed in 39us (26634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886554:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787787178.886566:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787787178.886572:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503650688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886603:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503650688:12345-0@lo:400:kworker.0 Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886609:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787787178.886636:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651328 00000100:00100000:2.0:1787787178.886640:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651328 00000100:00100000:2.0:1787787178.886660:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651840 00000100:00100000:2.0:1787787178.886663:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651840 00000100:00100000:2.0:1787787178.886672:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651200 00000100:00100000:2.0:1787787178.886674:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651200 00000100:00100000:2.0:1787787178.886684:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651712 00000100:00100000:2.0:1787787178.886686:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651712 00000100:00100000:2.0:1787787178.886698:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787787178.886704:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5943840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503651328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886735:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5943840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503651328:12345-0@lo:400:kworker.0 Request processed in 31us (26939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886740:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787787178.886750:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787178.886755:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503651840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787178.886755:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787178.886763:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503651200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.886781:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503651840:12345-0@lo:400:kworker.0 Request processed in 26us (26945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886786:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787787178.886795:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503651200:12345-0@lo:400:kworker.0 Request processed in 35us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.886796:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787178.891755:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503651712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.891881:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503651712:12345-0@lo:400:kworker.0 Request processed in 5072us (5903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787178.892658:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787178.892713:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652096 00000100:00100000:0.0:1787787178.892721:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652096 00000100:00100000:0.0:1787787178.892847:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787787178.892857:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874630503652096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787178.892875:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787178.892937:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874630503652096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (6874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787178.892944:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787787178.892986:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a76940 x1874630503651328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787178.894476:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503651328:0@lo:400:kworker.0 00010000:00080000:0.0:1787787178.894505:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a74780 x1874630503651840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787178.894514:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503651840:0@lo:400:kworker.0 00000100:00100000:0.0:1787787178.894525:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503650432:0@lo:400:kworker.0 00000100:00100000:0.0:1787787178.894537:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503650944:0@lo:400:kworker.0 00000100:00100000:0.0:1787787178.894549:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503651456:0@lo:400:kworker.0 00000100:00080000:0.0:1787787178.894585:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787178.894591:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787178.894594:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787178.897461:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787787178.897569:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418e1c0 x1874630503652096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787178.897595:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503652096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787178.897610:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503650688:0@lo:400:kworker.0 00010000:00080000:2.0:1787787178.897624:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7480 x1874630503651200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787178.897632:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503651200:0@lo:400:kworker.0 00010000:00080000:2.0:1787787178.897641:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a74b40 x1874630503651712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787178.897648:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503651712:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.897824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.898010:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503651584:0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.898050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787178.905834:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503650560:0@lo:400:kworker.0 00000100:00100000:3.0:1787787178.906648:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651072 00000100:00100000:3.0:1787787178.906658:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651072 00000100:00100000:3.0:1787787178.906775:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503651584 00000100:00100000:3.0:1787787178.906779:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503651584 00000100:00100000:2.0:1787787178.906839:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787787178.906851:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503651072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787178.906944:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503651072:12345-0@lo:400:kworker.0 Request processed in 96us (9120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787178.906962:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:2.0:1787787178.907015:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7840 x1874630503651072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787178.907027:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503651072:0@lo:400:kworker.0 00000100:00080000:1.0:1787787178.918382:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787178.918664:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787787178.918678:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787178.918781:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503651584:12345-0@lo:400:kworker.0 Request processed in 109us (20730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787178.918789:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:3.0:1787787178.918846:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a743c0 x1874630503651584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787178.918862:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503651584:0@lo:400:kworker.0 00010000:00010000:3.0:1787787179.822033:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787180.717886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.717944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.717986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.718016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.718040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.718063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.718107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787180.718172:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704512 00000100:00100000:1.0:1787787180.718183:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704512 00000100:00100000:1.0:1787787180.718240:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704384 00000100:00100000:1.0:1787787180.718243:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704384 00000100:00100000:1.0:1787787180.718265:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:1.0:1787787180.718276:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787180.718352:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787180.718360:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:1.0:1787787180.718375:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1787787180.718381:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4143c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787180.718403:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4143c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787180.718409:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1787787180.718425:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704000 00000100:00100000:1.0:1787787180.718429:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704000 00000100:00100000:1.0:1787787180.718449:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704256 00000100:00100000:1.0:1787787180.718452:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704256 00000100:00100000:1.0:1787787180.718463:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703872 00000100:00100000:1.0:1787787180.718466:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703872 00000100:00100000:1.0:1787787180.718494:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704128 00000100:00100000:1.0:1787787180.718497:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704128 00000100:00100000:1.0:1787787180.718510:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 145 00000100:00100000:1.0:1787787180.718516:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484704000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787180.718543:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484704000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787180.718550:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 145 00000100:00100000:1.0:1787787180.718563:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 146 00000100:00100000:1.0:1787787180.718570:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4143840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787180.718592:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4143840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787180.718598:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 146 00000100:00100000:1.0:1787787180.718609:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 147 00000100:00100000:1.0:1787787180.718615:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484703872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787180.718639:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484703872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787180.718644:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 147 00000100:00100000:1.0:1787787180.718656:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00100000:1.0:1787787180.718662:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787180.718684:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484704128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787180.718690:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00080000:0.0:1787787180.718981:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787180.718986:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787180.718989:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787180.718991:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787180.719421:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484703744 00000100:00100000:3.0:1787787180.719428:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484703744 00000100:00100000:3.0:1787787180.719475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 304 00000100:00100000:3.0:1787787180.719483:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2394:x1874630484703744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787180.719534:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2394:x1874630484703744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787180.719542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 304 00010000:00010000:2.0:1787787180.844687:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787181.420132:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503652352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787181.420221:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787181.420302:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652352 00000100:00100000:0.0:1787787181.420310:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652352 00000100:00100000:0.0:1787787181.420377:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787181.420386:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503652352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787181.420426:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787181.420474:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503652352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787181.420481:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787787181.420508:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787181.420539:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0f480 x1874630503652352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787181.420556:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503652352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787181.420701:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503652224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787181.420730:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787181.421044:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652224 00000100:00100000:0.0:1787787181.421049:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652224 00000100:00100000:0.0:1787787181.421081:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787181.421089:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503652224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787181.421101:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787181.421158:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503652224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787181.421165:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787787181.421192:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a0ad00 x1874630503652224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787181.421206:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503652224:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787787181.422067:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787787181.865327:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787182.891172:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787183.465778:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4142940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503652480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787183.465880:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787183.466183:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652480 00000100:00100000:2.0:1787787183.466191:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652480 00000100:00100000:2.0:1787787183.466246:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787787183.466256:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503652480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787183.466290:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787183.466469:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503652480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 215us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787183.466477:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787183.466554:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4142940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503652480:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787183.913993:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787183.979392:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787183.979416:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503652608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787183.979483:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787183.979546:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652608 00000100:00100000:0.0:1787787183.979553:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652608 00000100:00100000:0.0:1787787183.979611:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787787183.979621:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503652608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787183.979662:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787183.979841:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503652608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787183.979850:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787787183.979873:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787183.979886:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503652736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787183.980122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787787183.980193:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0e940 x1874630503652608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787183.980211:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503652608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787183.980278:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652736 00000100:00100000:3.0:1787787183.980283:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652736 00000100:00100000:3.0:1787787183.980320:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787787183.980335:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503652736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787183.980359:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787183.980395:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503652736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787183.980401:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787183.980460:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503652736:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1787787183.982673:0:12509:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787183.982999:0:12509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787787183.983853:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503652864:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.983931:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.983983:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503653376:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984028:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503653888:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984060:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984084:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787787183.984090:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503652992:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984129:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503653504:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984193:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503654016:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984213:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984237:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653376 00000100:00100000:1.0:1787787183.984243:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653376 00000100:00100000:1.0:1787787183.984286:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653888 00000100:00100000:1.0:1787787183.984289:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653888 00000100:00100000:1.0:1787787183.984305:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652992 00000100:00100000:1.0:1787787183.984307:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652992 00000100:00100000:1.0:1787787183.984317:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653504 00000100:00100000:1.0:1787787183.984319:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653504 00000100:00100000:1.0:1787787183.984330:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654016 00000100:00100000:1.0:1787787183.984333:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654016 00000100:00100000:1.0:1787787183.984348:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787787183.984356:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4141e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503653376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984403:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4141e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503653376:12345-0@lo:400:kworker.0 Request processed in 47us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.984410:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787787183.984427:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787787183.984433:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503653888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984471:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503653888:12345-0@lo:400:kworker.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.984477:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787787183.984489:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787787183.984495:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503652992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984519:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503652992:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.984526:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787787183.984537:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787787183.984543:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503653504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984568:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503653504:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.984574:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787787183.984584:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787787183.984590:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4142940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984616:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4142940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503654016:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.984621:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1787787183.984647:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787183.984651:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787183.984660:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503653120:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984718:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503653632:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984760:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503654144:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984790:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984824:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787787183.984830:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503653248:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984873:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503653760:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.984893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787183.984922:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653632 00000100:00100000:1.0:1787787183.984925:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653632 00000100:00100000:1.0:1787787183.984956:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654144 00000100:00100000:1.0:1787787183.984959:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654144 00000100:00100000:1.0:1787787183.984972:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653760 00000100:00100000:1.0:1787787183.984974:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653760 00000100:00100000:1.0:1787787183.984987:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787183.984993:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503653632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985026:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503653632:12345-0@lo:400:kworker.0 Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.985032:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787183.985044:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787183.985050:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503654144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985077:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503654144:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.985082:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787183.985093:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787787183.985099:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503653760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985167:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503653760:12345-0@lo:400:kworker.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.985173:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787787183.985204:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787183.985207:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787183.985216:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653248 00000100:00100000:1.0:1787787183.985219:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653248 00000100:00100000:1.0:1787787183.985242:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787183.985248:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503653248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985281:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503653248:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.985286:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787183.985320:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503653248:0@lo:400:kworker.0 00010000:00080000:1.0:1787787183.985335:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a08f00 x1874630503653760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787183.985345:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503653760:0@lo:400:kworker.0 00010000:00080000:1.0:1787787183.985355:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a08000 x1874630503653632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787183.985363:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503653632:0@lo:400:kworker.0 00010000:00080000:1.0:1787787183.985372:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a0a580 x1874630503654144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787183.985380:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503654144:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985413:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503652992:0@lo:400:kworker.0 00010000:00080000:1.0:1787787183.985423:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a0a940 x1874630503653504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787183.985430:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503653504:0@lo:400:kworker.0 00010000:00080000:1.0:1787787183.985439:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a08b40 x1874630503654016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787183.985454:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503654016:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985467:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503653376:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985476:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503653888:0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985497:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503653120 00000100:00100000:1.0:1787787183.985501:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503653120 00000100:00100000:1.0:1787787183.985524:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787183.985530:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503653120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787183.985564:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503653120:12345-0@lo:400:kworker.0 Request processed in 34us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787183.985570:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787183.985596:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503653120:0@lo:400:kworker.0 00000100:00100000:0.0:1787787183.985781:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503654272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787183.985831:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787183.985865:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654272 00000100:00100000:0.0:1787787183.985869:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654272 00000100:00100000:0.0:1787787183.985896:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787787183.985903:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503654272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787183.985918:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787183.985934:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503652864 00000100:00100000:3.0:1787787183.985940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503652864 00000100:00100000:0.0:1787787183.985955:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503654272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787183.985962:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787183.985972:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787787183.985981:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503652864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787183.986017:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503652864:12345-0@lo:400:kworker.0 Request processed in 38us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787183.986023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:0.0:1787787183.986066:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e61c0 x1874630503654272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787183.986082:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503654272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787183.986567:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503652864:0@lo:400:kworker.0 00010000:00010000:2.0:1787787184.938275:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787185.837777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787185.837830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787185.837861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787185.837888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787185.837907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787185.837923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787185.837946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787185.838106:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704896 00000100:00100000:0.0:1787787185.838115:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704896 00000100:00100000:0.0:1787787185.838227:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705152 00000100:00100000:0.0:1787787185.838231:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705152 00000100:00100000:0.0:1787787185.838245:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704768 00000100:00100000:0.0:1787787185.838249:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704768 00000100:00100000:0.0:1787787185.838260:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705024 00000100:00100000:0.0:1787787185.838262:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705024 00000100:00100000:0.0:1787787185.838279:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 155 00000100:00100000:0.0:1787787185.838289:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484704896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787185.838362:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484704896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787185.838370:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 155 00000100:00100000:0.0:1787787185.838403:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 156 00000100:00100000:0.0:1787787185.838410:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787185.838550:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787185.838556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 156 00000100:00100000:0.0:1787787185.838569:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 157 00000100:00100000:0.0:1787787185.838575:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484704768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787185.838598:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484704768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787185.838603:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 157 00000100:00100000:0.0:1787787185.838613:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 158 00000100:00100000:0.0:1787787185.838618:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787185.838654:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787185.838660:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 158 00000100:00100000:2.0:1787787185.838742:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484704640 00000100:00100000:2.0:1787787185.838748:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484704640 00000100:00100000:2.0:1787787185.838793:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 306 00000100:00100000:2.0:1787787185.838801:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484704640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787185.838836:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484704640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787185.838842:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 306 00000100:00080000:3.0:1787787185.839039:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787185.839044:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787185.839992:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705408 00000100:00100000:1.0:1787787185.840000:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705408 00000100:00100000:0.0:1787787185.840101:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705280 00000100:00100000:0.0:1787787185.840106:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705280 00000100:00100000:1.0:1787787185.840220:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:1.0:1787787185.840230:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787185.840286:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 58us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787185.840294:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00080000:3.0:1787787185.859902:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787185.859912:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787185.860645:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:1.0:1787787185.860664:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787185.860748:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (22801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787185.860787:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00010000:00010000:1.0:1787787185.961396:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787186.233086:0:12607:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787186.233373:0:12607:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787787186.537590:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503654400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787186.537679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787186.537838:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654400 00000100:00100000:0.0:1787787186.537847:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654400 00000100:00100000:0.0:1787787186.537932:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787787186.537943:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503654400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787186.537978:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787186.538033:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503654400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787186.538041:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787787186.538273:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e61c0 x1874630503654400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787186.538292:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503654400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787186.538937:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787186.539167:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503654528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787186.539229:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787186.539330:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654528 00000100:00100000:3.0:1787787186.539336:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654528 00000100:00100000:3.0:1787787186.539388:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787787186.539398:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503654528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787186.539420:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787186.539460:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503654528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787186.539466:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787787186.539521:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787186.539577:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a09680 x1874630503654528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787186.539592:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503654528:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787787186.985337:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787188.009761:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787188.587062:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503654656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787188.587160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787188.587277:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654656 00000100:00100000:0.0:1787787188.587284:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654656 00000100:00100000:0.0:1787787188.587324:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787787188.587331:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503654656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787188.587364:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787188.587405:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503654656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787188.587420:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787787188.587584:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503654656:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1787787188.611687:0:12704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787188.611940:0:12704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787787189.049302:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787189.098914:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503654784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787189.098992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787189.099082:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503654912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787189.099108:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787189.099159:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654784 00000100:00100000:0.0:1787787189.099166:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654784 00000100:00100000:0.0:1787787189.099217:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503654912 00000100:00100000:0.0:1787787189.099221:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503654912 00000100:00100000:0.0:1787787189.099238:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787189.099245:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503654784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787189.099272:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787189.099312:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503654784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787189.099318:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787189.099332:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787189.099337:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503654912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787189.099346:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787189.099367:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503654912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787189.099372:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787787189.099385:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787787189.099413:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e7840 x1874630503654912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787189.099449:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503654912:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787787189.099477:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e43c0 x1874630503654784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787189.099487:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503654784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787189.101740:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503655040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787189.101867:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.101933:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655040 00000100:00100000:3.0:1787787189.101940:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655040 00000100:00100000:3.0:1787787189.101986:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787787189.101993:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503655040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787189.102028:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787189.102073:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503655040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102079:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787787189.102123:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503655040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787189.102245:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503655168:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102274:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.102295:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503655680:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102331:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.102349:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503656192:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.102386:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787787189.102391:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503655296:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102425:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.102441:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503655808:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102461:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.102474:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503656320:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102505:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.102526:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655168 00000100:00100000:3.0:1787787189.102529:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655168 00000100:00100000:3.0:1787787189.102557:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787787189.102563:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503655168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102595:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503655168:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102601:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787787189.102624:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655680 00000100:00100000:3.0:1787787189.102627:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655680 00000100:00100000:3.0:1787787189.102655:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656192 00000100:00100000:3.0:1787787189.102658:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656192 00000100:00100000:3.0:1787787189.102673:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655296 00000100:00100000:3.0:1787787189.102676:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655296 00000100:00100000:3.0:1787787189.102685:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655808 00000100:00100000:3.0:1787787189.102687:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655808 00000100:00100000:3.0:1787787189.102713:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656320 00000100:00100000:3.0:1787787189.102716:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656320 00000100:00100000:3.0:1787787189.102731:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787787189.102735:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503655680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102763:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503655680:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102769:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787787189.102778:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787189.102791:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503656192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102818:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503656192:12345-0@lo:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102823:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787189.102833:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787189.102839:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503655296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102860:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503655296:12345-0@lo:400:kworker.0 Request processed in 22us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102865:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787189.102875:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787189.102880:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503655808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102901:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503655808:12345-0@lo:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102906:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787189.102916:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787787189.102921:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503656320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.102943:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503656320:12345-0@lo:400:kworker.0 Request processed in 22us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.102948:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1787787189.102975:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787189.102979:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787189.102987:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503655424:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103012:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.103029:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503655936:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103050:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.103079:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787787189.103086:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503655552:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103108:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.103123:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503656064:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103163:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787189.103190:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655936 00000100:00100000:3.0:1787787189.103193:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655936 00000100:00100000:3.0:1787787189.103220:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656064 00000100:00100000:3.0:1787787189.103223:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656064 00000100:00100000:3.0:1787787189.103241:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787189.103247:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503655936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103281:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503655936:12345-0@lo:400:kworker.0 Request processed in 35us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.103287:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787189.103298:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787189.103303:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503656064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103328:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503656064:12345-0@lo:400:kworker.0 Request processed in 25us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.103334:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1787787189.103349:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787189.103356:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655552 00000100:00100000:3.0:1787787189.103359:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655552 00000100:00100000:3.0:1787787189.103378:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787787189.103383:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503655552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103410:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503655552:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.103415:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787787189.103458:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503655296:0@lo:400:kworker.0 00010000:00080000:3.0:1787787189.103470:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa24f00 x1874630503655808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787189.103480:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503655808:0@lo:400:kworker.0 00010000:00080000:3.0:1787787189.103489:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f7480 x1874630503656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787189.103498:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503656320:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103507:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503655168:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103516:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503655680:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103524:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503656192:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103553:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503655552:0@lo:400:kworker.0 00010000:00080000:3.0:1787787189.103563:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa27480 x1874630503656064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787189.103570:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503656064:0@lo:400:kworker.0 00010000:00080000:3.0:1787787189.103578:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa270c0 x1874630503655936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787189.103585:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503655936:0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103602:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503655424 00000100:00100000:3.0:1787787189.103606:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503655424 00000100:00100000:3.0:1787787189.103626:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787787189.103632:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503655424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787189.103675:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503655424:12345-0@lo:400:kworker.0 Request processed in 44us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787189.103681:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787787189.103720:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503655424:0@lo:400:kworker.0 00010000:00010000:1.0:1787787190.064615:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787190.960017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787190.960237:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706176 00000100:00100000:0.0:1787787190.960247:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706176 00000100:00100000:0.0:1787787190.960301:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706304 00000100:00100000:0.0:1787787190.960305:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706304 00000100:00100000:0.0:1787787190.960330:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787190.960339:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2390:x1874630484706176:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1787787190.960371:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8e06 00000100:00080000:0.0:1787787190.960381:0:8441:0:(import.c:65:import_set_state_nolock()) ffff986fc3419000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787190.960428:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787787190.960611:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+2:2390:x1874630484706176:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 272us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787190.960619:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787190.960635:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:0.0:1787787190.960642:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2390:x1874630484706304:12345-192.168.204.31@tcp:9:kworker.0 00000100:00100000:3.0:1787787190.961335:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705664 00000100:00100000:3.0:1787787190.961341:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705664 00000100:00100000:3.0:1787787190.961369:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705920 00000100:00100000:3.0:1787787190.961371:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705920 00000100:00100000:3.0:1787787190.961382:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705792 00000100:00100000:3.0:1787787190.961384:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705792 00000100:00100000:3.0:1787787190.961405:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706048 00000100:00100000:3.0:1787787190.961408:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706048 00000100:00100000:3.0:1787787190.961422:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:3.0:1787787190.961429:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484705664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787190.961476:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484705664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787190.961483:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:3.0:1787787190.961498:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:3.0:1787787190.961504:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787190.961530:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484705920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787190.961536:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:3.0:1787787190.961548:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:3.0:1787787190.961554:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484705792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787190.961588:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484705792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787190.961605:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:3.0:1787787190.961619:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 168 00000100:00100000:3.0:1787787190.961626:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484706048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787190.961649:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484706048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787190.962037:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484705536 00000100:00100000:1.0:1787787190.962043:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484705536 00000100:00100000:1.0:1787787190.962079:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 308 00000100:00100000:1.0:1787787190.962086:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484705536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787190.962115:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484705536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787190.962122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 308 00010000:00010000:1.0:1787787190.962188:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787190.962360:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787190.962364:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787190.962367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787190.962369:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787190.966173:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 168 00000020:00000080:0.0:1787787190.967304:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8e0d 00000100:00080000:0.0:1787787190.967318:0:8441:0:(import.c:65:import_set_state_nolock()) ffff986fc341f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787190.967373:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787787190.971048:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787190.973863:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+2:2390:x1874630484706304:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 13210us (13750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787190.973878:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00010000:00010000:2.0:1787787191.082587:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787787191.472788:0:12802:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787191.473007:0:12802:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787787191.673203:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503656448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787191.673296:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787191.674700:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503656576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787191.674752:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787191.676974:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656448 00000100:00100000:3.0:1787787191.676989:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656448 00000100:00100000:3.0:1787787191.677057:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656576 00000100:00100000:3.0:1787787191.677060:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656576 00000100:00100000:3.0:1787787191.677086:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787787191.677096:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503656448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787191.677133:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787191.677251:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503656448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787191.677258:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787787191.677273:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787787191.677279:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503656576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787191.677288:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787191.677314:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503656576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787191.677330:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1787787191.677373:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356bc00 x1874630503656448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787191.677393:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503656448:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787787191.677450:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa270c0 x1874630503656576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787191.677464:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503656576:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787787191.692728:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787192.121951:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787193.135531:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787193.709923:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503656704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787193.710054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787193.710216:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656704 00000100:00100000:1.0:1787787193.710226:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656704 00000100:00100000:1.0:1787787193.710290:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787193.710300:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503656704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787193.710348:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787193.710413:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503656704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787193.710420:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787193.710874:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503656704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787787194.153327:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787194.217765:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503657216:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.217851:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.217899:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503657728:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.217923:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.217946:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503658240:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.217977:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.218008:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787787194.218014:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503656832:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.218061:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503657344:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.218104:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503657856:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.218175:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503658368:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.218228:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657216 00000100:00100000:2.0:1787787194.218242:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657216 00000100:00100000:2.0:1787787194.218288:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787787194.218295:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503657216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218344:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503657216:12345-0@lo:400:kworker.0 Request processed in 49us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787194.218351:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787787194.218387:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657728 00000100:00100000:2.0:1787787194.218390:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657728 00000100:00100000:2.0:1787787194.218415:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658240 00000100:00100000:2.0:1787787194.218418:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658240 00000100:00100000:2.0:1787787194.218430:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657856 00000100:00100000:2.0:1787787194.218433:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657856 00000100:00100000:2.0:1787787194.218444:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658368 00000100:00100000:2.0:1787787194.218447:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658368 00000100:00100000:2.0:1787787194.218460:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787194.218465:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503657728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218493:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503657728:12345-0@lo:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787194.218499:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787194.218509:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787787194.218514:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503658240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218537:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503658240:12345-0@lo:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787194.218542:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787787194.218551:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787787194.218556:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503657856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218575:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503657856:12345-0@lo:400:kworker.0 Request processed in 19us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787194.218590:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787787194.218612:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787787194.218619:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503658368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218648:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503658368:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787194.218654:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787787194.218674:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657344 00000100:00100000:2.0:1787787194.218678:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657344 00000100:00100000:2.0:1787787194.218705:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787787194.218710:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503657344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.218739:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503657344:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787194.218745:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787787194.219115:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787194.219120:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787194.219178:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503657344:0@lo:400:kworker.0 00010000:00080000:2.0:1787787194.219193:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418d2c0 x1874630503657856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787194.219202:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503657856:0@lo:400:kworker.0 00010000:00080000:2.0:1787787194.219212:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f7b480 x1874630503658368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787194.219220:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503658368:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.219232:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503657216:0@lo:400:kworker.0 00010000:00080000:2.0:1787787194.219241:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418cb40 x1874630503657728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787194.219258:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503657728:0@lo:400:kworker.0 00010000:00080000:2.0:1787787194.219269:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f7a940 x1874630503658240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787194.219276:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503658240:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220217:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503656960:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220273:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787194.220308:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503657472:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220327:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787194.220346:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503657984:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220366:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787194.220389:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787787194.220396:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503657088:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220476:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787194.220494:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503657600:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220513:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787194.220527:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503658112:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220542:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787194.220570:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656832 00000100:00100000:3.0:1787787194.220576:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656832 00000100:00100000:3.0:1787787194.220655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787787194.220664:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503656832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.220979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503656832:12345-0@lo:400:kworker.0 Request processed in 315us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.220987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787787194.221020:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503656960 00000100:00100000:3.0:1787787194.221024:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503656960 00000100:00100000:3.0:1787787194.221041:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657472 00000100:00100000:3.0:1787787194.221043:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657472 00000100:00100000:3.0:1787787194.221064:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657984 00000100:00100000:3.0:1787787194.221067:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657984 00000100:00100000:3.0:1787787194.221079:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657600 00000100:00100000:3.0:1787787194.221081:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657600 00000100:00100000:3.0:1787787194.221090:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658112 00000100:00100000:3.0:1787787194.221092:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658112 00000100:00100000:3.0:1787787194.221103:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787787194.221109:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503656960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221171:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503656960:12345-0@lo:400:kworker.0 Request processed in 62us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.221177:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787787194.221188:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787787194.221194:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503657472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221221:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503657472:12345-0@lo:400:kworker.0 Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.221226:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787787194.221236:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787787194.221242:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503657984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221266:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503657984:12345-0@lo:400:kworker.0 Request processed in 25us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.221279:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787787194.221290:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787787194.221295:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503657600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221323:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503657600:12345-0@lo:400:kworker.0 Request processed in 28us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.221329:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787787194.221340:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787787194.221345:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503658112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221370:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503658112:12345-0@lo:400:kworker.0 Request processed in 25us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.221376:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1787787194.221396:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787194.221400:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787787194.221446:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418de00 x1874630503657600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787194.221646:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503657600:0@lo:400:kworker.0 00010000:00080000:3.0:1787787194.221665:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f7a1c0 x1874630503658112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787194.221674:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503658112:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221743:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503656960:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221756:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503657472:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221766:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503657984:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.221802:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503657088 00000100:00100000:3.0:1787787194.222305:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503657088 00000100:00100000:3.0:1787787194.222346:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787787194.222354:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503657088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.222412:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503657088:12345-0@lo:400:kworker.0 Request processed in 60us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787194.222419:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787787194.222894:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787194.222908:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503658752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787194.223945:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503658496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787194.224071:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787194.224124:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503657088:0@lo:400:kworker.0 00000100:00100000:2.0:1787787194.224165:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787194.224172:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503658624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787194.224213:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503656832:0@lo:400:kworker.0 00000100:00100000:3.0:1787787194.224285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787194.224405:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658496 00000100:00100000:0.0:1787787194.224413:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658496 00000100:00100000:0.0:1787787194.224591:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787787194.224613:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503658496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787194.224650:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787194.228312:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787194.228470:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658752 00000100:00100000:1.0:1787787194.228480:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658752 00000100:00100000:1.0:1787787194.228526:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658624 00000100:00100000:1.0:1787787194.228529:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658624 00000100:00100000:1.0:1787787194.228546:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787194.228639:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503658752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787194.228677:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787194.228731:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503658752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (4445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787194.228741:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503658496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4138us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787194.228743:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787194.228756:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787194.228767:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787194.228777:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503658624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787194.228787:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787194.228819:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503658624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787194.228825:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787787194.228866:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4172940 x1874630503658752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787194.228886:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503658752:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787787194.232812:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41712c0 x1874630503658624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787194.232841:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503658624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787194.232858:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503658496:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1787787194.233391:0:12900:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787194.235739:0:12900:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787787195.182326:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787196.081809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787196.081864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787196.081900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787196.081920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787196.081948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787196.081978:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706560 00000100:00100000:0.0:1787787196.081989:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706560 00000100:00100000:0.0:1787787196.082057:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706816 00000100:00100000:0.0:1787787196.082060:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706816 00000100:00100000:0.0:1787787196.082089:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706688 00000100:00100000:0.0:1787787196.082092:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706688 00000100:00100000:0.0:1787787196.082102:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706944 00000100:00100000:0.0:1787787196.082104:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706944 00000100:00100000:0.0:1787787196.082119:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 175 00000100:00100000:0.0:1787787196.082129:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484706560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787196.082222:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484706560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787196.082230:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 175 00000100:00100000:0.0:1787787196.082248:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 176 00000100:00100000:0.0:1787787196.082254:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484706816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787196.082278:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484706816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787196.082284:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 176 00000100:00100000:0.0:1787787196.082295:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 177 00000100:00100000:0.0:1787787196.082302:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484706688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787196.082323:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484706688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787196.082329:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 177 00000100:00100000:0.0:1787787196.082339:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 178 00000100:00100000:0.0:1787787196.082345:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484706944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787196.082367:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484706944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787196.082372:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 178 00000100:00100000:0.0:1787787196.082393:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484706432 00000100:00100000:0.0:1787787196.082403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484706432 00000100:00100000:0.0:1787787196.082447:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 310 00000100:00100000:0.0:1787787196.082454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484706432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787196.082486:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484706432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787196.082493:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 310 00000100:00080000:0.0:1787787196.082526:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787196.082529:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787196.202500:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787196.778121:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503659008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787196.778227:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787196.778398:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659008 00000100:00100000:0.0:1787787196.778416:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659008 00000100:00100000:0.0:1787787196.778476:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787787196.778486:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503659008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787196.778517:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787196.778574:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503659008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787196.778581:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1787787196.778641:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4170000 x1874630503659008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787196.778964:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503659008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787196.779130:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503658880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787196.779205:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787196.779255:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503658880 00000100:00100000:2.0:1787787196.779260:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503658880 00000100:00100000:2.0:1787787196.779293:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787787196.779300:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503658880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787196.779314:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787196.779348:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503658880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787196.779355:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1787787196.779383:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a08000 x1874630503658880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787196.779433:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503658880:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787787196.780327:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787787196.785360:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000020:00000080:2.0:1787787196.785369:0:9520:0:(genops.c:885:class_export_put()) final put ffff986fc341d800/12b28a37-797d-4b20-85b7-441f77f74f4f 00000020:00000080:1.0:1787787196.785469:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc341d800/12b28a37-797d-4b20-85b7-441f77f74f4f for lustre-OST0001 00000001:00100000:0.0:1787787196.785590:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000020:00000080:0.0:1787787196.785595:0:8436:0:(genops.c:885:class_export_put()) final put ffff986fc341a000/12b28a37-797d-4b20-85b7-441f77f74f4f 00000020:00000080:1.0:1787787196.786052:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc341f800 for lustre-OST0001 00000020:00000080:1.0:1787787196.786076:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc341a000/12b28a37-797d-4b20-85b7-441f77f74f4f for lustre-OST0000 00000020:00000080:1.0:1787787196.786292:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc3419000 for lustre-OST0000 00010000:00010000:2.0:1787787197.225377:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787197.829209:0:13044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787787198.250701:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787198.826447:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503659136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787198.826572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787198.826921:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659136 00000100:00100000:1.0:1787787198.826931:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659136 00000100:00100000:1.0:1787787198.827000:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787198.827012:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503659136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787198.827062:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787198.827133:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503659136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787198.827172:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787198.827232:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503659136:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787199.275495:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787199.338027:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503659520:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338092:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.338151:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503660032:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338173:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.338202:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503660544:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338221:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.338248:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787787199.338254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503659648:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338278:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.338295:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503660160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338315:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.338345:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503660672:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338365:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.338398:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659520 00000100:00100000:0.0:1787787199.338406:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659520 00000100:00100000:0.0:1787787199.338450:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787199.338459:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503659520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338678:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503659520:12345-0@lo:400:kworker.0 Request processed in 63us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.338689:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787199.338712:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660032 00000100:00100000:0.0:1787787199.338716:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660032 00000100:00100000:0.0:1787787199.338753:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660544 00000100:00100000:0.0:1787787199.338756:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660544 00000100:00100000:0.0:1787787199.338766:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660160 00000100:00100000:0.0:1787787199.338769:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660160 00000100:00100000:0.0:1787787199.338779:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660672 00000100:00100000:0.0:1787787199.338781:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660672 00000100:00100000:0.0:1787787199.338867:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787199.338874:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503660032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338908:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503660032:12345-0@lo:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.338925:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787199.338938:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787787199.338944:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503660544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.338974:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503660544:12345-0@lo:400:kworker.0 Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.338979:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787787199.338990:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787199.338996:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5942940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503660160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.339021:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5942940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503660160:12345-0@lo:400:kworker.0 Request processed in 26us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.339026:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787199.339037:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787199.339043:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503660672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.339067:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503660672:12345-0@lo:400:kworker.0 Request processed in 24us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.339072:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787199.339092:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659648 00000100:00100000:0.0:1787787199.339095:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659648 00000100:00100000:0.0:1787787199.339120:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787787199.339125:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f59421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503659648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.339174:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f59421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503659648:12345-0@lo:400:kworker.0 Request processed in 48us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.339180:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787787199.339220:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503659648:0@lo:400:kworker.0 00010000:00080000:0.0:1787787199.339233:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e63840 x1874630503660160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.339251:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503660160:0@lo:400:kworker.0 00010000:00080000:0.0:1787787199.339265:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e61e00 x1874630503660672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.339274:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503660672:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.339283:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503659520:0@lo:400:kworker.0 00010000:00080000:0.0:1787787199.339292:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ec000 x1874630503660032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.339299:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503660032:0@lo:400:kworker.0 00010000:00080000:0.0:1787787199.339308:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e62940 x1874630503660544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.339315:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503660544:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.339449:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503659392:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.339479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.339497:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503659904:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340030:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.340052:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503660416:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340073:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.340092:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787787199.340098:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503659264:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340123:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.340171:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503659776:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340205:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.340222:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503660288:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.340269:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659392 00000100:00100000:0.0:1787787199.340273:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659392 00000100:00100000:0.0:1787787199.340295:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659904 00000100:00100000:0.0:1787787199.340298:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659904 00000100:00100000:0.0:1787787199.340311:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660416 00000100:00100000:0.0:1787787199.340314:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660416 00000100:00100000:0.0:1787787199.340338:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659776 00000100:00100000:0.0:1787787199.340342:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659776 00000100:00100000:0.0:1787787199.340354:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660288 00000100:00100000:0.0:1787787199.340357:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660288 00000100:00100000:0.0:1787787199.340371:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787787199.340377:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5942580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503659392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340422:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5942580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503659392:12345-0@lo:400:kworker.0 Request processed in 44us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.340428:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787787199.340444:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787787199.340450:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503659904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340474:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503659904:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.340480:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787787199.340490:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787787199.340495:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503660416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340705:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503660416:12345-0@lo:400:kworker.0 Request processed in 209us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.340723:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787787199.340736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787787199.340742:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503659776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340771:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503659776:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.340777:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787787199.340853:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787787199.340860:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503660288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340888:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503660288:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.340893:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787787199.340917:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503659264 00000100:00100000:0.0:1787787199.340921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503659264 00000100:00100000:0.0:1787787199.340947:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787787199.340953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503659264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.340982:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503659264:12345-0@lo:400:kworker.0 Request processed in 30us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.340987:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787787199.341035:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503659264:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.341047:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503659776:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.341055:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503660288:0@lo:400:kworker.0 00000100:00100000:0.0:1787787199.341064:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503659392:0@lo:400:kworker.0 00010000:00080000:0.0:1787787199.341073:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ec780 x1874630503659904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.341090:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503659904:0@lo:400:kworker.0 00010000:00080000:0.0:1787787199.341102:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e60780 x1874630503660416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.341110:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503660416:0@lo:400:kworker.0 00000100:00080000:3.0:1787787199.344356:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787199.344367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787199.344371:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787199.344373:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787199.344449:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503660800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787199.344533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.345484:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787199.345496:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503660928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787199.345552:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.345599:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660928 00000100:00100000:0.0:1787787199.345606:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660928 00000100:00100000:0.0:1787787199.345651:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787199.345659:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503660928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787199.345696:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787787199.345744:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503660928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.345751:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787199.346067:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503660928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787199.346122:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503660800 00000100:00100000:0.0:1787787199.346127:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503660800 00000100:00100000:0.0:1787787199.346181:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787787199.346188:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503660800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787199.368541:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787199.368653:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787199.368671:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503661056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787199.368734:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787199.368819:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503661056 00000100:00100000:0.0:1787787199.368826:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503661056 00000100:00100000:0.0:1787787199.368867:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787787199.368875:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503661056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787199.368895:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787199.368925:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503661056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.368933:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1787787199.368970:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e60780 x1874630503661056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.368989:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503661056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787199.369041:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503660800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 22853us (24508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787199.369048:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1787787199.369073:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a0b840 x1874630503660800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787199.369086:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503660800:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787787200.298302:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787201.204432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787201.204494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787201.204520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787201.204523:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707328 00000100:00100000:0.0:1787787201.204533:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707328 00000100:00100000:0.0:1787787201.204596:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707584 00000100:00100000:3.0:1787787201.204602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787201.204603:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707584 00000100:00100000:0.0:1787787201.204623:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707200 00000100:00100000:0.0:1787787201.204626:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707200 00000100:00100000:3.0:1787787201.204643:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707072 00000100:00100000:3.0:1787787201.204649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707072 00000100:00100000:3.0:1787787201.204683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 312 00000100:00100000:3.0:1787787201.204692:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484707072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787201.204717:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 185 00000100:00100000:0.0:1787787201.204728:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484707328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787201.204842:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 186 00000100:00100000:1.0:1787787201.204853:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484707584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787201.204904:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484707328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787201.204918:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 185 00000100:00100000:0.0:1787787201.204935:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 187 00000100:00100000:0.0:1787787201.204941:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484707200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1787787201.206078:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787201.206086:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787201.206840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484707072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2142us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.206852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 312 00000100:00100000:1.0:1787787201.207887:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484707584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 3031us (3360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.207899:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 186 00000100:00100000:0.0:1787787201.207980:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484707200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 3036us (3378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787201.207989:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 187 00000100:00100000:0.0:1787787201.219484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787201.219576:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707456 00000100:00100000:1.0:1787787201.219587:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707456 00000100:00100000:1.0:1787787201.219670:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 188 00000100:00100000:1.0:1787787201.219682:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484707456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787201.219768:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484707456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.219776:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 188 00000100:00080000:3.0:1787787201.228252:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787787201.324182:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787201.802203:0:13193:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5be96ec0 20000000:00000080:0.0:1787787201.802240:0:13193:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff986fc3b6f400 uarg=0000000000000000 20000000:01000000:0.0:1787787201.802320:0:13193:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787787201.802330:0:13193:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787787201.802339:0:13193:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787787201.804362:0:13194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787787201.804696:0:13193:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787787201.817628:0:13193:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787787201.817681:0:13193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817699:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817707:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817714:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817720:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817746:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817753:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817760:0:13193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.817801:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.818028:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 12 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.818043:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661184:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787201.818191:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.818200:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 12 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.818209:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661312:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787201.818244:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.818251:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 23 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.818273:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661440:0@lo:104: 00000100:00100000:0.0:1787787201.818317:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787201.818352:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.818360:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 23 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.818368:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661568:0@lo:104: 00000100:00100000:0.0:1787787201.818386:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.818423:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503661440 00000100:00100000:0.0:1787787201.818429:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503661440 00000100:00100000:0.0:1787787201.818479:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503661568 00000100:00100000:0.0:1787787201.818483:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503661568 00000100:00100000:0.0:1787787201.818498:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787201.818517:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:13193:x1874630503661440:12345-0@lo:104: 00010000:00010000:0.0:1787787201.818529:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.818572:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787201.818578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:13193:x1874630503661440:12345-0@lo:104: Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787201.818585:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787201.818604:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787787201.818610:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:13193:x1874630503661568:12345-0@lo:104: 00010000:00010000:0.0:1787787201.818618:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.818663:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787201.818668:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:13193:x1874630503661568:12345-0@lo:104: Request processed in 58us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1787787201.819099:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787201.819113:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819122:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787201.819126:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819135:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787201.819174:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787201.819180:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787201.819209:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819216:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787201.819237:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819244:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454e000/0x11620bc3f30a8dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819258:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787201.819262:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819268:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454ee00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787201.819271:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819287:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787201.819294:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787201.819299:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787201.819315:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819321:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787201.819337:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819343:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454ee00/0x11620bc3f30a8dc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819353:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787201.819354:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787201.819356:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787201.819369:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503661696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787201.819406:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.819447:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503661824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787201.819482:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.819532:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503661696 00000100:00100000:1.0:1787787201.819536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503661696 00010000:00010000:1.0:1787787201.819557:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 24 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.819588:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503661824 00000100:00100000:1.0:1787787201.819592:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503661824 00010000:00010000:1.0:1787787201.819604:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 25 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.819617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787787201.819623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+25:3656:x1874630503661696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787201.819632:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787201.819637:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 25 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819645:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 25 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.819661:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787201.820039:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+25:3656:x1874630503661696:12345-0@lo:103:ldlm_bl.0 Request processed in 414us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.820047:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787787201.820064:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787787201.820070:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503661824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787201.820078:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787201.820082:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 24 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.820091:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 24 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.820102:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787201.820158:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503661824:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.820166:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787787201.820199:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503661824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787201.820273:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503661696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787201.820610:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1787787201.820918:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787201.821383:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.821396:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 23 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.821408:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661952:0@lo:104: 00000100:00100000:0.0:1787787201.821465:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787201.821617:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.821626:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 23 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.821634:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503662080:0@lo:104: 00000100:00100000:0.0:1787787201.821670:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.827546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787201.827645:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787201.828127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707712 00000100:00100000:2.0:1787787201.828163:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707712 00010000:00010000:2.0:1787787201.828204:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 13 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.828236:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707840 00000100:00100000:2.0:1787787201.828239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707840 00010000:00010000:2.0:1787787201.828253:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 14 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.828267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787201.828274:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3568780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+14:2391:x1874630484707712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787201.828287:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787201.828293:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 14 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.828305:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 14 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.828334:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787201.828386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3568780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+14:2391:x1874630484707712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.828393:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787201.828411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1787787201.828418:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484707840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787201.828426:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787201.828431:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 13 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.828442:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 13 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.828450:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787201.828480:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484707840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.828486:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1787787201.834692:0:13193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870ffa31f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787787201.834743:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c805b expref: 12 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.834763:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661184:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787201.834777:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4000/0x11620bc3f30a8ddc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c801c expref: 11 pid: 6519 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.834785:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661312:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787201.834831:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4800/0x11620bc3f30a8dd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8dce expref: 23 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.834840:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661440:0@lo:104: 00010000:00010000:2.0:1787787201.834851:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454e800/0x11620bc3f30a8dc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8dc0 expref: 22 pid: 6522 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.834860:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661568:0@lo:104: 00000100:00100000:3.0:1787787201.835223:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503661952 00000100:00100000:3.0:1787787201.835231:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503661952 00000100:00100000:2.0:1787787201.835594:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662080 00000100:00100000:2.0:1787787201.835599:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662080 00000100:00100000:2.0:1787787201.835615:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787201.835623:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:13193:x1874630503661952:12345-0@lo:104: 00010000:00010000:2.0:1787787201.835640:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.835754:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787201.835761:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+4:13193:x1874630503661952:12345-0@lo:104: Request processed in 139us (14306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.835768:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787201.835785:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787201.835792:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:13193:x1874630503662080:12345-0@lo:104: 00010000:00010000:2.0:1787787201.835801:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.836123:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503661952:0@lo:104: 00010000:00010000:2.0:1787787201.836237:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787787201.836243:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:697ab143-19fe-4215-afba-68a282afbaf6+3:13193:x1874630503662080:12345-0@lo:104: Request processed in 452us (14573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.836250:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787787201.836282:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787201.836288:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836296:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787201.836300:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836308:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787201.836314:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787201.836320:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787201.836356:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836362:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787201.836382:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836389:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454e600/0x11620bc3f30a8db2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8db9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836399:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787201.836402:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836407:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454ea00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787201.836410:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836424:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787201.836431:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787201.836436:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787201.836450:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836467:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787201.836484:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836491:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454ea00/0x11620bc3f30a8da4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8dab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.836519:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787201.836521:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787201.836523:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787201.836537:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503662336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787201.836587:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787201.836627:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503662208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787201.836652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.836897:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1874630503662080:0@lo:104: 00010000:00010000:0.0:1787787201.836930:0:13193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.837068:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662336 00000100:00100000:2.0:1787787201.837073:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662336 00010000:00010000:2.0:1787787201.837096:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 22 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.837130:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662208 00000100:00100000:2.0:1787787201.837133:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662208 00010000:00010000:2.0:1787787201.837169:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 23 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.837181:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787201.837187:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+23:3655:x1874630503662336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787201.837198:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787201.837204:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 23 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837213:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 23 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837227:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3e00/0x11620bc3f30a8dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8da4 expref: 23 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837239:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787201.837268:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+22:3655:x1874630503662336:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.837274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787201.837285:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787201.837291:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+21:3654:x1874630503662208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787201.837298:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787201.837302:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 21 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837311:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 21 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454f400/0x11620bc3f30a8db9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8db2 expref: 21 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837338:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837345:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837357:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837363:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837370:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837377:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837382:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8ac00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787201.837385:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837393:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837404:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.837423:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787201.837451:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:697ab143-19fe-4215-afba-68a282afbaf6+20:3654:x1874630503662208:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.837470:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787201.838207:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503662208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787201.838236:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503662336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787201.838374:0:13193:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.838396:0:13193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.838403:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8ac00/0x11620bc3f30a8e14 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.845058:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787201.897384:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787201.897407:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503662464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787201.897487:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.897645:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662464 00000100:00100000:0.0:1787787201.897665:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662464 00000100:00100000:0.0:1787787201.897737:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787787201.897748:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3568f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503662464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787201.897779:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787201.897840:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3568f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503662464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787201.897847:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1787787201.897889:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff959a40 x1874630503662464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787201.897909:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503662464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787201.898068:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787201.899451:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503662592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787201.899512:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787201.900995:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662592 00000100:00100000:3.0:1787787201.901008:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662592 00000100:00100000:3.0:1787787201.901083:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787787201.901093:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff959a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503662592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787201.901117:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787787201.901183:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787201.901390:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff959a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503662592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 298us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.901398:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1787787201.901473:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356bc00 x1874630503662592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787201.901496:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503662592:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787787202.345280:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787203.369555:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787787203.433868:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787203.433876:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f5ba1800 from 7 10000000:01000000:3.0:1787787203.433882:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787203.433932:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.433945:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.433956:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787203.433990:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503662720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787203.434057:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787203.434110:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787203.434235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662720 00000100:00100000:1.0:1787787203.434242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662720 00000100:00100000:1.0:1787787203.434293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787787203.434302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503662720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787203.434316:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787203.434330:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8e1b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.434352:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.434362:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.434371:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5200, rc 0) 00000100:00100000:1.0:1787787203.434417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503662720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787203.434444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787787203.434505:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503662720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787203.434518:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.434526:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787203.434581:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503662848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.434603:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.434618:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787203.434630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662848 00000100:00100000:1.0:1787787203.434634:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662848 00000100:00100000:1.0:1787787203.434657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787787203.434664:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503662848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.434770:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503662848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787203.434777:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787787203.434809:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503662848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.434836:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503662976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.434876:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.434889:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787203.434901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503662976 00000100:00100000:1.0:1787787203.434904:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503662976 00000100:00100000:1.0:1787787203.434924:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787787203.434936:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503662976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.435024:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503662976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787203.435031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787787203.435072:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503662976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787203.436378:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787787203.436597:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787787203.436619:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787203.436629:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.436640:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787203.436649:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787203.436652:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc17b800 from 7 10000000:01000000:1.0:1787787203.436655:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787203.436684:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.436692:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.436702:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787203.436720:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.436766:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.436806:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787203.436947:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663104 00000100:00100000:2.0:1787787203.436953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663104 00000100:00100000:2.0:1787787203.437065:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787787203.437075:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503663104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787203.437086:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787203.437098:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8e29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.437118:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.437128:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.437194:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787203.437325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503663104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.437350:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787787203.439317:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787203.439345:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.439358:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787203.445238:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.445303:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787203.446230:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787203.447065:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663232 00000100:00100000:3.0:1787787203.447073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663232 00000100:00100000:3.0:1787787203.447130:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787787203.447157:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503663232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787203.447293:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503663232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787203.447300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787787203.447460:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787203.447573:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787203.447624:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787203.447654:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787203.447693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663360 00000100:00100000:2.0:1787787203.447697:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663360 00000100:00100000:2.0:1787787203.447722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787787203.447728:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503663360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.447813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503663360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.447820:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787787203.447931:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787787203.449837:0:13222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787787203.450079:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787787203.450101:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787203.450112:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.450124:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787203.450134:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787787203.450159:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870d2373000 from 7 10000000:01000000:2.0:1787787203.450161:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787203.450192:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.450200:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.450225:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787203.450247:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.450300:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787203.450341:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787203.450595:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663488 00000100:00100000:3.0:1787787203.450602:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663488 00000100:00100000:3.0:1787787203.450658:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787787203.450667:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503663488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787203.450680:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787203.450692:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8e37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.450716:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.450726:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.450735:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:3.0:1787787203.450783:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503663488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787203.450790:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787787203.450866:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787203.450887:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.450896:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787203.450954:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.451061:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.451086:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787203.451128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663616 00000100:00100000:3.0:1787787203.451133:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663616 00000100:00100000:3.0:1787787203.451185:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787787203.451192:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503663616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787203.451291:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503663616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787203.451298:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787787203.451413:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.451454:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.451564:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.451586:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787203.451626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663744 00000100:00100000:3.0:1787787203.451630:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663744 00000100:00100000:3.0:1787787203.451658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787787203.451664:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503663744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787203.451811:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503663744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787203.451825:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787787203.455555:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787203.462340:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787787203.465578:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787787203.465615:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787203.465628:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.465641:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787203.465651:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787203.465654:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3240800 from 7 10000000:01000000:1.0:1787787203.465657:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787203.465693:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.465713:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.465725:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787203.465749:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.465818:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.465906:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787203.470184:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503663872 00000100:00100000:3.0:1787787203.470201:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503663872 00000100:00100000:3.0:1787787203.470254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787787203.470264:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503663872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787203.470282:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787203.470302:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8e45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.470329:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.470341:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787203.470351:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7000, rc 0) 00000100:00100000:3.0:1787787203.470419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503663872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (4601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787203.470437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787787203.470633:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503663872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787203.470652:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787203.470662:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787203.470735:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503664000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787203.470770:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787203.470801:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787203.470862:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664000 00000100:00100000:2.0:1787787203.470868:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664000 00000100:00100000:2.0:1787787203.470901:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787787203.470907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503664000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.471025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503664000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.471031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787787203.471062:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503664000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.471091:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503664128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.471158:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787203.471178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664128 00000100:00100000:2.0:1787787203.471182:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664128 00000100:00100000:2.0:1787787203.471200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787787203.471206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503664128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.471275:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503664128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.471281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787787203.471319:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787203.471330:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503664128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787203.471996:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787787203.472047:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787787203.472065:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787203.472073:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.472083:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787203.635269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787203.636988:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484707968 00000100:00100000:0.0:1787787203.637003:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484707968 00000100:00100000:0.0:1787787203.637066:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 325 00000100:00100000:0.0:1787787203.637077:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:6164:x1874630484707968:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787203.637094:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787203.637113:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c808c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787203.637168:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787203.637179:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787203.637189:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8bc00, rc 0) 00000100:00100000:0.0:1787787203.637258:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484707968:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 182us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787203.637266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 325 00000100:00100000:2.0:1787787203.649205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787203.649304:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708096 00000100:00100000:3.0:1787787203.649314:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708096 00000100:00100000:3.0:1787787203.649373:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 326 00000100:00100000:3.0:1787787203.649383:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484708096:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787203.649539:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484708096:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 156us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787203.649548:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 326 00000100:00100000:1.0:1787787203.652444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787203.652805:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708224 00000100:00100000:2.0:1787787203.652815:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708224 00000100:00100000:2.0:1787787203.652877:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 327 00000100:00100000:2.0:1787787203.652887:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484708224:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.653012:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484708224:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 126us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.653020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 327 00000100:00100000:0.0:1787787203.665793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787203.665891:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708352 00000100:00100000:2.0:1787787203.665902:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708352 00000100:00100000:2.0:1787787203.665963:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 328 00000100:00100000:2.0:1787787203.665974:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484708352:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787203.666013:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787203.666032:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8093 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.666063:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.666085:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787203.666095:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2200, rc 0) 00000100:00100000:2.0:1787787203.666171:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484708352:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 198us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.666178:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 328 00000100:00100000:3.0:1787787203.675313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787203.682341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708480 00000100:00100000:2.0:1787787203.682355:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708480 00000100:00100000:2.0:1787787203.682427:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 329 00000100:00100000:2.0:1787787203.682439:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484708480:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.682607:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484708480:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 170us (7304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.682616:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 329 00000100:00100000:2.0:1787787203.688030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787203.688067:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708608 00000100:00100000:2.0:1787787203.688075:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708608 00000100:00100000:2.0:1787787203.688126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 330 00000100:00100000:2.0:1787787203.688697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484708608:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787203.688856:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484708608:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 707us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787203.688865:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 330 00000100:00100000:2.0:1787787203.949641:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503664256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787203.949720:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787203.949959:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664256 00000100:00100000:0.0:1787787203.949967:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664256 00000100:00100000:0.0:1787787203.950019:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787787203.950028:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503664256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787203.950063:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787203.950121:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503664256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787203.950128:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787787203.950910:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503664256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787204.398781:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787204.457454:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503664384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787204.457537:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457596:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503664896:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457620:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457639:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503665408:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457662:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457678:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503665920:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457717:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787787204.457723:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503664512:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457746:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457766:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503665024:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457785:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457800:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503665536:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457818:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457862:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503664640:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457900:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503665152:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457927:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503665664:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.457955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.457984:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787787204.457991:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503664768:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458012:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.458029:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503665280:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.458065:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503665792:0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787204.458262:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664384 00000100:00100000:0.0:1787787204.458270:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664384 00000100:00100000:0.0:1787787204.458307:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664768 00000100:00100000:0.0:1787787204.458311:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664768 00000100:00100000:0.0:1787787204.458326:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787787204.458334:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503664384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787204.458370:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787787204.458429:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503664384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458436:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787787204.458451:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787204.458457:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503664768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458487:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503664768:12345-0@lo:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458494:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787204.458510:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664896 00000100:00100000:0.0:1787787204.458514:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664896 00000100:00100000:0.0:1787787204.458529:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665024 00000100:00100000:0.0:1787787204.458531:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665024 00000100:00100000:0.0:1787787204.458548:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665536 00000100:00100000:0.0:1787787204.458550:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665536 00000100:00100000:0.0:1787787204.458567:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664640 00000100:00100000:0.0:1787787204.458570:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664640 00000100:00100000:0.0:1787787204.458578:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665152 00000100:00100000:0.0:1787787204.458579:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665152 00000100:00100000:0.0:1787787204.458589:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665664 00000100:00100000:0.0:1787787204.458591:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665664 00000100:00100000:0.0:1787787204.458603:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787787204.458608:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503664896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458637:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503664896:12345-0@lo:400:kworker.0 Request processed in 28us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458642:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787787204.458652:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787787204.458657:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503665024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458679:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503665024:12345-0@lo:400:kworker.0 Request processed in 23us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458685:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787787204.458694:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787787204.458699:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503665536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458722:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503665536:12345-0@lo:400:kworker.0 Request processed in 23us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458727:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787787204.458737:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787787204.458742:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503664640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458763:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503664640:12345-0@lo:400:kworker.0 Request processed in 21us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458767:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787787204.458775:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787787204.458786:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503665152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.458811:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503665152:12345-0@lo:400:kworker.0 Request processed in 26us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787204.458816:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787787204.459320:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787787204.459331:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787204.459368:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503665664:12345-0@lo:400:kworker.0 Request processed in 40us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.459550:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665408 00000100:00100000:1.0:1787787204.459558:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665408 00000100:00100000:1.0:1787787204.459587:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665920 00000100:00100000:1.0:1787787204.459590:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665920 00000100:00100000:1.0:1787787204.459602:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665280 00000100:00100000:1.0:1787787204.459605:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665280 00000100:00100000:1.0:1787787204.459630:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503665792 00000100:00100000:1.0:1787787204.459633:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503665792 00000100:00100000:1.0:1787787204.459661:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787204.459667:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503665408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.459703:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503665408:12345-0@lo:400:kworker.0 Request processed in 37us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.459709:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787204.459722:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787204.459728:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503665920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.459753:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503665920:12345-0@lo:400:kworker.0 Request processed in 26us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.459758:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787204.459768:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787204.459773:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503665280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.459796:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503665280:12345-0@lo:400:kworker.0 Request processed in 24us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.459801:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787204.459812:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787204.459818:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503665792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.459842:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503665792:12345-0@lo:400:kworker.0 Request processed in 25us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.459848:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787204.459897:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503665024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.459911:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503665536:0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.459927:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503664384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787204.459937:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503664896:0@lo:400:kworker.0 00010000:00080000:1.0:1787787204.459961:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ef840 x1874630503665408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.459972:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503665408:0@lo:400:kworker.0 00010000:00080000:1.0:1787787204.459982:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa0da40 x1874630503665920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.459991:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503665920:0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.460019:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787204.460030:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503666048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787204.460061:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787204.460104:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787204.460109:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787204.460112:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787204.460114:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787204.460129:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503666176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787204.460177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787204.460203:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503664768:0@lo:400:kworker.0 00010000:00080000:1.0:1787787204.460213:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ec000 x1874630503665280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.460220:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503665280:0@lo:400:kworker.0 00010000:00080000:1.0:1787787204.460229:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e63840 x1874630503665792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.460235:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503665792:0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.460245:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503664640:0@lo:400:kworker.0 00010000:00080000:1.0:1787787204.460265:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ee1c0 x1874630503665152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.460273:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503665152:0@lo:400:kworker.0 00010000:00080000:1.0:1787787204.460282:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4170000 x1874630503665664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.460290:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503665664:0@lo:400:kworker.0 00000100:00100000:1.0:1787787204.460328:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666048 00000100:00100000:1.0:1787787204.460332:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666048 00000100:00100000:1.0:1787787204.460357:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666176 00000100:00100000:1.0:1787787204.460360:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666176 00000100:00100000:1.0:1787787204.460373:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787204.460378:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503666048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787204.460398:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787204.460448:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503666048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.460454:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787787204.460467:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787204.460473:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3568780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503666176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787204.460482:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787204.460510:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3568780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503666176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787204.460516:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1787787204.460544:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc10b2940 x1874630503666176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.460556:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503666176:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787787204.460588:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356b480 x1874630503666048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787204.460599:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503666048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787204.461842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503664512 00000100:00100000:3.0:1787787204.461852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503664512 00000100:00100000:3.0:1787787204.461904:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787787204.461904:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787787204.461913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503664512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787204.461979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503664512:12345-0@lo:400:kworker.0 Request processed in 66us (4231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787204.461986:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787787204.462841:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503664512:0@lo:400:kworker.0 00010000:00010000:2.0:1787787205.418485:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787206.286321:0:13391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787787206.317237:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787206.317282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787206.317309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787206.317347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708736 00000100:00100000:3.0:1787787206.317357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708736 00000100:00100000:3.0:1787787206.317426:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 332 00000100:00100000:3.0:1787787206.317443:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484708736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787206.317541:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484708736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787206.317549:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 332 00000100:00100000:3.0:1787787206.317586:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708992 00000100:00100000:3.0:1787787206.317591:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708992 00000100:00100000:3.0:1787787206.317631:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709248 00000100:00100000:3.0:1787787206.317635:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709248 00000100:00100000:3.0:1787787206.317662:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:3.0:1787787206.317671:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484708992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787206.317709:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484708992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787206.317726:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:3.0:1787787206.317744:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:3.0:1787787206.317766:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787206.317798:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787206.317805:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00080000:3.0:1787787206.319285:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787206.324404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787206.324440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787206.324593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484708864 00000100:00100000:1.0:1787787206.324603:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484708864 00000100:00100000:1.0:1787787206.324667:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709120 00000100:00100000:1.0:1787787206.324670:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709120 00000100:00100000:1.0:1787787206.324695:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 197 00000100:00100000:1.0:1787787206.324705:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484708864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787206.324799:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484708864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787206.324807:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 197 00000100:00100000:1.0:1787787206.324825:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00100000:1.0:1787787206.324832:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787206.324857:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787206.324862:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00080000:0.0:1787787206.325639:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787206.444174:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787207.018041:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503666432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787207.018116:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787207.018283:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666432 00000100:00100000:1.0:1787787207.018292:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666432 00000100:00100000:1.0:1787787207.018367:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787787207.018379:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503666432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787207.018419:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787207.018486:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503666432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787207.018495:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787787207.018542:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787207.018556:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503666304:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787787207.018570:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356b480 x1874630503666432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787207.018590:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503666432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787207.018605:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787207.018646:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666304 00000100:00100000:0.0:1787787207.018650:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666304 00000100:00100000:0.0:1787787207.018683:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787787207.018690:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503666304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787207.018701:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787207.018732:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503666304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787207.018739:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787787207.018752:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787207.018770:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a77840 x1874630503666304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787207.018798:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503666304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787787207.467634:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787208.490281:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787209.068185:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503666560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787209.068274:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787209.068485:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666560 00000100:00100000:0.0:1787787209.068494:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666560 00000100:00100000:0.0:1787787209.068558:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787787209.068567:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503666560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787209.068607:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787209.068665:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503666560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787209.068672:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787787209.070731:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503666560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787209.516280:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787209.577538:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503666688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787209.577623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787209.577661:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503666816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787209.577787:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666688 00000100:00100000:1.0:1787787209.577795:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666688 00000100:00100000:1.0:1787787209.577863:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787209.577875:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503666688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787209.577905:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787787209.577969:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787209.578163:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787209.578594:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503667200:0@lo:400:kworker.0 00000100:00100000:0.0:1787787209.578644:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503667072:0@lo:400:kworker.0 00000100:00100000:1.0:1787787209.584886:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503666688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7004us (7253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787209.584901:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787209.585014:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503667456:0@lo:400:kworker.0 00000100:00100000:1.0:1787787209.585062:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787209.585090:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503667968:0@lo:400:kworker.0 00000100:00100000:1.0:1787787209.585116:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787209.585168:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667456 00000100:00100000:1.0:1787787209.585176:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667456 00000100:00100000:2.0:1787787209.585639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787209.585675:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787787209.585698:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503667456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787209.586111:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503667712:0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586152:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787209.586174:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503668224:0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586194:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787787209.586236:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc356b480 x1874630503666688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787209.586258:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503666688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787209.586278:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787787209.586285:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503667328:0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787209.586359:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503667840:0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586394:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787209.586422:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503668352:0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586443:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787209.586475:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667200 00000100:00100000:3.0:1787787209.586480:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667200 00000100:00100000:3.0:1787787209.586507:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667712 00000100:00100000:3.0:1787787209.586509:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667712 00000100:00100000:3.0:1787787209.586530:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668224 00000100:00100000:3.0:1787787209.586532:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668224 00000100:00100000:3.0:1787787209.586546:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787787209.586552:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503667200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586587:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503667200:12345-0@lo:400:kworker.0 Request processed in 35us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787209.586593:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787787209.586607:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787787209.586613:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503667712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586638:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503667712:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787209.586644:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787787209.586653:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787787209.586659:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503668224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.586685:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503668224:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787209.586705:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787787209.586723:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667968 00000100:00100000:3.0:1787787209.586726:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667968 00000100:00100000:3.0:1787787209.586753:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667840 00000100:00100000:3.0:1787787209.586755:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667840 00000100:00100000:3.0:1787787209.586765:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668352 00000100:00100000:3.0:1787787209.586767:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668352 00000100:00100000:3.0:1787787209.586777:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787787209.586782:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503667968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787209.596854:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787209.597047:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787787209.597066:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503667840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597129:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503667840:12345-0@lo:400:kworker.0 Request processed in 72us (10734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.597157:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787787209.597178:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787787209.597187:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503668352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597218:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503668352:12345-0@lo:400:kworker.0 Request processed in 33us (10774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.597224:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787787209.597241:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787209.597246:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787209.597249:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787787209.597281:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5858780 x1874630503667840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787209.597291:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5859a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503667584:0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597301:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503667840:0@lo:400:kworker.0 00010000:00080000:2.0:1787787209.597350:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95da40 x1874630503668352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787209.597350:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787209.597362:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503668352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597390:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503667200:0@lo:400:kworker.0 00010000:00080000:2.0:1787787209.597411:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f58583c0 x1874630503667712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787209.597421:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f58583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503667712:0@lo:400:kworker.0 00010000:00080000:2.0:1787787209.597431:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5859680 x1874630503668224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787209.597439:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5859680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503668224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597493:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667072 00000100:00100000:2.0:1787787209.597499:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667072 00000100:00100000:2.0:1787787209.597533:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787787209.597539:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503667072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597572:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503667072:12345-0@lo:400:kworker.0 Request processed in 33us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.597577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787787209.597603:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667584 00000100:00100000:2.0:1787787209.597607:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667584 00000100:00100000:2.0:1787787209.597630:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787787209.597635:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503667584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597661:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503667584:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.597666:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1787787209.597699:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787209.597710:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503667328 00000100:00100000:2.0:1787787209.597713:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503667328 00000100:00100000:2.0:1787787209.597738:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787787209.597744:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503667328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787209.597758:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503668096:0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597783:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503667328:12345-0@lo:400:kworker.0 Request processed in 38us (11460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.597789:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787787209.597800:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787209.597822:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503667328:0@lo:400:kworker.0 00000100:00100000:0.0:1787787209.597828:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503666944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787209.597855:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787209.597875:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666816 00000100:00100000:2.0:1787787209.597881:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666816 00000100:00100000:0.0:1787787209.597891:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503667072:0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.597908:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787787209.597917:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503666816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787209.597920:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5859a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503667584:0@lo:400:kworker.0 00002000:00000024:2.0:1787787209.597939:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787209.597947:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668096 00000100:00100000:0.0:1787787209.597952:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668096 00000100:00100000:2.0:1787787209.597982:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503666816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (12342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.597989:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787209.598000:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787787209.598009:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503668096:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787787209.598029:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc10b0780 x1874630503666816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787209.598046:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503666816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787209.598051:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503668096:12345-0@lo:400:kworker.0 Request processed in 42us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787209.598067:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1787787209.598077:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787209.598091:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503666944 00000100:00100000:2.0:1787787209.598095:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503666944 00000100:00100000:0.0:1787787209.598103:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503668096:0@lo:400:kworker.0 00000100:00100000:2.0:1787787209.598117:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787787209.598125:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503666944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787209.598181:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787787209.598231:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503666944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787209.598237:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787787209.598259:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503666944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787209.605921:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503667456:12345-0@lo:400:kworker.0 Request processed in 20227us (20848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787209.605955:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787787209.608715:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503667456:0@lo:400:kworker.0 00010000:00080000:1.0:1787787209.609560:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f585a1c0 x1874630503667968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787209.609576:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f585a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503667968:0@lo:400:kworker.0 00000100:00100000:3.0:1787787209.610231:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503667968:12345-0@lo:400:kworker.0 Request processed in 23442us (25107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787209.610245:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1787787210.550497:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787211.436855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787211.437135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787211.440186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787211.440228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787211.440310:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709376 00000100:00100000:3.0:1787787211.440333:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709376 00000100:00100000:3.0:1787787211.440414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00100000:3.0:1787787211.440425:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484709376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787211.440515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484709376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787211.440522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00100000:1.0:1787787211.443850:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709504 00000100:00100000:1.0:1787787211.443870:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709504 00000100:00100000:1.0:1787787211.444004:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709760 00000100:00100000:1.0:1787787211.444008:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709760 00000100:00100000:1.0:1787787211.444026:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709632 00000100:00100000:1.0:1787787211.444029:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709632 00000100:00100000:1.0:1787787211.444056:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:1.0:1787787211.444067:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484709504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787211.444177:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484709504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 111us (7337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787211.444186:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:1.0:1787787211.444206:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 206 00000100:00100000:1.0:1787787211.444212:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787211.444236:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (7103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787211.444242:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 206 00000100:00100000:2.0:1787787211.444286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787211.444347:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484709888 00000100:00100000:1.0:1787787211.444351:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484709888 00000100:00100000:1.0:1787787211.444368:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 207 00000100:00100000:1.0:1787787211.444373:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484709632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787211.444427:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484709632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787211.444433:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 207 00000100:00100000:2.0:1787787211.444441:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 208 00000100:00100000:2.0:1787787211.444451:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787211.444478:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484709888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787211.444485:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 208 00000100:00080000:3.0:1787787211.444600:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787211.444606:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787787211.563345:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787212.138983:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503668480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787212.139323:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787212.139435:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc403e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503668608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787212.139469:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787212.139515:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668480 00000100:00100000:3.0:1787787212.139522:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668480 00000100:00100000:3.0:1787787212.139571:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668608 00000100:00100000:3.0:1787787212.139574:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668608 00000100:00100000:3.0:1787787212.139592:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787787212.139601:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503668480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787212.139638:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787212.140531:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787212.140553:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503668608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787212.140572:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787212.141888:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503668608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1340us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.141902:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787787212.145004:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503668480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5392us (5670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787212.145019:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787787212.145059:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787212.145109:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc403e940 x1874630503668608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787212.145133:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc403e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503668608:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787787212.147610:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95e580 x1874630503668480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787212.147637:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503668480:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787787212.187979:0:13542:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:33:30 (1787787210) === 00000100:00100000:2.0:1787787212.535866:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.535918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787212.535936:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484710016 00000100:00100000:1.0:1787787212.535948:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484710016 00000100:00100000:3.0:1787787212.536002:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484710144 00000100:00100000:3.0:1787787212.536007:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484710144 00000100:00100000:1.0:1787787212.536017:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787212.536030:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484710016:12345-192.168.204.31@tcp:41:mkdir.0 00000100:00100000:3.0:1787787212.536053:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:3.0:1787787212.536063:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10477:x1874630484710144:12345-192.168.204.31@tcp:700:mkdir.0 00000004:00000024:1.0:1787787212.536075:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787212.536178:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10477:x1874630484710144:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787212.536181:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484710016:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 152us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787212.536194:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:1.0:1787787212.536196:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:2.0:1787787212.545241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787212.546914:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484710400 00000100:00100000:3.0:1787787212.546928:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484710400 00000100:00100000:3.0:1787787212.546994:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1787787212.547005:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f585a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:10477:x1874630484710400:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1787787212.547060:0:7753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787212.547177:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a8d03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8007 expref: 6 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.547199:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d200) 00010000:00010000:3.0:1787787212.547210:0:7753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787212.547317:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.547333:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.547343:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.547446:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.547458:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.547467:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548104:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548114:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548130:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787212.548170:0:7753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b079387 reply state 00000000bbba049e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548181:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548188:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc3a1db00) 00010000:00010000:2.0:1787787212.548191:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787212.548194:0:7753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787787212.548199:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787787212.548207:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548214:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548220:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548227:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787212.548231:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548239:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548258:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c900) 00010000:00010000:2.0:1787787212.548261:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787212.548272:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548278:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a8e61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787212.548294:0:7753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b079387 reply state 00000000bbba049e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548302:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.548308:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787212.548310:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787212.548313:0:7753:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787787212.548484:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f585a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10477:x1874630484710400:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1477us (3251us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787787212.548492:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:1.0:1787787212.570473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.570551:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484710528 00000100:00100000:2.0:1787787212.570562:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484710528 00000100:00100000:2.0:1787787212.570628:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:2.0:1787787212.570638:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10481:x1874630484710528:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1787787212.570660:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787212.570684:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8e76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c809a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.570749:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a8e7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.570764:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a8e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.570794:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a8e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787212.570848:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787212.570852:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787212.570889:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a8e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.570916:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c809a expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.571119:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a8e7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c809a expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.571129:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787212.571133:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787212.571136:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2800, rc 0) 00000100:00100000:2.0:1787787212.571365:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:10481:x1874630484710528:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 727us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787212.571374:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:0.0:1787787212.583805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.583886:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484710784 00000100:00100000:2.0:1787787212.583895:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484710784 00000100:00100000:2.0:1787787212.583955:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:2.0:1787787212.583965:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:10481:x1874630484710784:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1787787212.584029:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787212.584054:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a8e7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c809a expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.584092:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787212.584104:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787212.584130:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.584189:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.584200:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787212.584430:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056efbcad reply state 000000000fc2b9d4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.584443:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.584450:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:2.0:1787787212.584453:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787787212.584456:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787787212.584463:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787787212.584542:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:10481:x1874630484710784:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 578us (746us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787787212.584550:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00010000:00010000:1.0:1787787212.585636:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787212.620242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787212.620886:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484710912 00000100:00100000:1.0:1787787212.620898:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484710912 00000100:00100000:1.0:1787787212.620970:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:1.0:1787787212.620982:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:10482:x1874630484710912:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1787787212.621010:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787212.621038:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a8e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.621128:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30a8e92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.621166:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30a8e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.621181:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30a8e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787212.621233:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787787212.621237:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787212.623904:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30a8e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.623966:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a8e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80a1 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.623992:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30a8e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80a1 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.624002:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:1.0:1787787212.624005:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787212.624009:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5000, rc 0) 00000100:00100000:0.0:1787787212.626945:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:10482:x1874630484710912:12345-192.168.204.31@tcp:101:chown.0 Request processed in 5952us (6698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.626959:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:3.0:1787787212.637712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.638051:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484711040 00000100:00100000:2.0:1787787212.638062:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484711040 00000100:00100000:2.0:1787787212.638125:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:2.0:1787787212.638136:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:10482:x1874630484711040:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:2.0:1787787212.638200:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787212.638232:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80a8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638476:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638492:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638504:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638515:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638522:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638528:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638601:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8eae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638610:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.638617:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787212.638975:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787212.638979:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787212.639002:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639023:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639030:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639038:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639045:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787212.639049:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639056:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639070:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:2.0:1787787212.639073:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787212.639077:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639084:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639098:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639104:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639110:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639122:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787212.639125:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639132:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639179:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787212.639182:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787212.639186:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639191:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639221:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80a8 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639236:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8eae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80a8 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.639243:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc3a1db00) 00010000:00010000:2.0:1787787212.639256:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787212.639259:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2000, rc 0) 00000100:00100000:2.0:1787787212.641354:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:10482:x1874630484711040:12345-192.168.204.31@tcp:101:chown.0 Request processed in 3210us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787212.641538:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:2.0:1787787212.645513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.645609:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484711168 00000100:00100000:0.0:1787787212.645620:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484711168 00000100:00100000:0.0:1787787212.645802:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:0.0:1787787212.645813:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5859a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:10482:x1874630484711168:12345-192.168.204.31@tcp:900:chown.0 00000100:00100000:0.0:1787787212.645942:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5859a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:10482:x1874630484711168:12345-192.168.204.31@tcp:900:chown.0 Request processed in 131us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.645950:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:0.0:1787787212.654625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.654714:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484711424 00000100:00100000:2.0:1787787212.654724:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484711424 00000100:00100000:2.0:1787787212.654787:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:2.0:1787787212.654799:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c13270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:10482:x1874630484711424:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:2.0:1787787212.654852:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787212.654881:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8eae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80a8 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.654902:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc3a1db00) 00010000:00010000:2.0:1787787212.654907:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787212.654928:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.654942:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.654952:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787212.658258:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787787212.658370:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021873574 reply state 000000001f40ce98 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.658394:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.658404:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc3a1db00) 00010000:00010000:2.0:1787787212.658407:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787787212.658411:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787787212.658423:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787787212.658520:0:6529:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787787212.658539:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c13270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:10482:x1874630484711424:12345-192.168.204.31@tcp:36:chown.0 Request processed in 3739us (3920us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787787212.658558:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00010000:00010000:1.0:1787787212.660454:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660473:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660480:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660494:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787212.660497:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660503:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660517:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff986fc3a1d600) 00010000:00010000:1.0:1787787212.660519:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787212.660522:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660527:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a8e68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660546:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660550:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660554:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660557:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787212.660558:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660562:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660573:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc3a1db00) 00010000:00010000:1.0:1787787212.660574:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787212.660577:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660580:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a8e6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660589:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660593:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660596:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660599:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787212.660601:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660604:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660615:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:1.0:1787787212.660617:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787787212.660618:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787212.660622:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a8e84 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661861:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661877:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661884:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661890:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787212.661895:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661902:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661916:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc3a1db00) 00010000:00010000:3.0:1787787212.661920:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787787212.661924:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.661930:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a8eb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787212.684262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.684483:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484711552 00000100:00100000:0.0:1787787212.684506:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484711552 00000100:00100000:0.0:1787787212.684570:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1787787212.684580:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:10483:x1874630484711552:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:0.0:1787787212.684605:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787212.684763:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a8ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80af expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787212.695537:0:7753:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 10717us 00010000:00010000:0.0:1787787212.712864:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.712888:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.712903:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.712920:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.712928:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.712935:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713068:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a8ed1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713078:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a8ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713097:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a8ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787212.713130:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787212.713134:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787212.713195:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a8ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713209:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713215:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713222:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713228:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787212.713232:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713239:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713263:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:0.0:1787787212.713266:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787212.713271:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713278:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a8ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713300:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713307:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713314:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713319:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787212.713322:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713328:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713336:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9870d4ceca00) 00010000:00010000:0.0:1787787212.713339:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787212.713342:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713360:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8eca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713399:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a8ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80af expref: 8 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713414:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a8ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80af expref: 7 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.713434:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:0.0:1787787212.713437:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787787212.713440:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8ac00, rc 0) 00000100:00100000:0.0:1787787212.713516:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10483:x1874630484711552:12345-192.168.204.31@tcp:101:touch.500 Request processed in 28936us (29273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.713526:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1787787212.720101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.720262:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484711808 00000100:00100000:2.0:1787787212.720273:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484711808 00000100:00100000:2.0:1787787212.720455:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787212.720573:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1325a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10483:x1874630484711808:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:2.0:1787787212.720595:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787212.720617:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8ed8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.720808:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.720824:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.720836:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.720896:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.720904:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.720912:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787212.722400:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787787212.722613:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a8eed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722656:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a8eed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722666:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a8eed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722707:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722714:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722721:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722726:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787212.722730:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722737:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722750:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:2.0:1787787212.722753:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787212.722759:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722766:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8edf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787212.722782:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dde1e860 reply state 00000000e757cce1 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722802:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722809:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787212.722812:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787212.722815:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787787212.722853:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a8ed8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80b6 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722868:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a8eed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80b6 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.722876:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787212.722878:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787212.722881:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2e00, rc 0) 00000100:00100000:2.0:1787787212.722963:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1325a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:10483:x1874630484711808:12345-192.168.204.31@tcp:101:touch.500 Request processed in 2498us (2872us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787787212.722971:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:0.0:1787787212.728307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.728437:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484712064 00000100:00100000:2.0:1787787212.728449:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484712064 00000100:00100000:2.0:1787787212.728587:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:2.0:1787787212.728598:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1324780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:10483:x1874630484712064:12345-192.168.204.31@tcp:36:touch.500 00010000:00010000:2.0:1787787212.728823:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787212.728852:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a8eed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80b6 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.728872:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787212.728900:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787212.728953:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.728968:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.728978:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787212.729093:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dddba81a reply state 000000007a039f78 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.729108:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.729115:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787212.729117:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787212.729120:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787212.731081:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1324780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:10483:x1874630484712064:12345-192.168.204.31@tcp:36:touch.500 Request processed in 1027us (1328us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787787212.731096:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:3.0:1787787212.732775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.736687:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484712192 00000100:00100000:0.0:1787787212.736702:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484712192 00000100:00100000:0.0:1787787212.737001:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:0.0:1787787212.737012:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:10483:x1874630484712192:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:0.0:1787787212.737037:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787212.737059:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8f02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.737121:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8f02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80bd expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.737168:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8f02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80bd expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.737190:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:0.0:1787787212.737194:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787212.737198:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b200, rc 0) 00000100:00100000:0.0:1787787212.737286:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:10483:x1874630484712192:12345-192.168.204.31@tcp:101:touch.500 Request processed in 275us (4519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.737320:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:0.0:1787787212.743732:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.743871:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484712320 00000100:00100000:2.0:1787787212.743881:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484712320 00000100:00100000:2.0:1787787212.743931:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:2.0:1787787212.743938:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1874630484712320:12345-192.168.204.31@tcp:8:touch.500 00010000:00080000:2.0:1787787212.743979:0:8443:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:2.0:1787787212.744011:0:8443:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a8f09 00002000:00100000:2.0:1787787212.744023:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99b164f2-528a-4a42-8406-031dcbc8cfdb/ffff986fc341b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787212.744041:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787212.744116:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787212.744190:0:8443:0:(import.c:65:import_set_state_nolock()) ffff986fc341c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787212.744269:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484712320:12345-192.168.204.31@tcp:8:touch.500 Request processed in 329us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787212.744303:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1787787212.749950:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.750830:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484712448 00000100:00100000:2.0:1787787212.750841:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484712448 00000100:00100000:2.0:1787787212.750910:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:2.0:1787787212.750921:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:0:x1874630484712448:12345-192.168.204.31@tcp:2:touch.500 00000100:00080000:3.0:1787787212.751573:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787787212.761283:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1787787212.761306:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000100:00100000:2.0:1787787212.761604:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:0:x1874630484712448:12345-192.168.204.31@tcp:2:touch.500 Request processed in 10679us (11657us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787787212.761616:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787212.767391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.767772:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484712704 00000100:00100000:2.0:1787787212.767783:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484712704 00000100:00100000:2.0:1787787212.767845:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:2.0:1787787212.767855:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:10483:x1874630484712704:12345-192.168.204.31@tcp:35:touch.500 00000100:00100000:2.0:1787787212.768167:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:10483:x1874630484712704:12345-192.168.204.31@tcp:35:touch.500 Request processed in 312us (784us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787787212.768176:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:0.0:1787787212.809540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.810346:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484712832 00000100:00100000:2.0:1787787212.810361:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484712832 00000100:00100000:3.0:1787787212.810562:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:3.0:1787787212.810572:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:10484:x1874630484712832:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1787787212.810606:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787212.810628:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80c4 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.810693:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a8f17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.810708:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a8f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.810720:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a8f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787212.810770:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787212.810774:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787212.810815:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a8f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.810843:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80c4 expref: 15 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.810882:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a8f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80c4 expref: 14 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.810892:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:3.0:1787787212.810895:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787212.810899:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031e00, rc 0) 00000100:00100000:3.0:1787787212.810968:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:10484:x1874630484712832:12345-192.168.204.31@tcp:101:rm.0 Request processed in 397us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787212.810976:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:2.0:1787787212.816184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.816301:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484713088 00000100:00100000:0.0:1787787212.816311:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484713088 00000100:00100000:0.0:1787787212.816375:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:0.0:1787787212.816387:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5859680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:10484:x1874630484713088:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1787787212.816406:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787212.816428:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b400/0x11620bc3f30a8f1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787212.816529:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787787212.816681:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b400/0x11620bc3f30a8f1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80cb expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.816698:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:0.0:1787787212.816701:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787212.816704:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b400/0x11620bc3f30a8f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80cb expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.816717:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b400, rc 0) 00000100:00100000:0.0:1787787212.817920:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5859680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:10484:x1874630484713088:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1524us (1789us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1787787212.817928:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:1.0:1787787212.823439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.823513:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484713216 00000100:00100000:2.0:1787787212.823523:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484713216 00000100:00100000:2.0:1787787212.823583:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1787787212.823594:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:10484:x1874630484713216:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:2.0:1787787212.834804:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:10484:x1874630484713216:12345-192.168.204.31@tcp:37:rm.0 Request processed in 11199us (11361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787212.834819:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1787787212.843453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.843561:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484713472 00000100:00100000:0.0:1787787212.843571:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484713472 00000100:00100000:0.0:1787787212.843630:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:0.0:1787787212.843639:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0d4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:10484:x1874630484713472:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1787787212.843838:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0d4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:10484:x1874630484713472:12345-192.168.204.31@tcp:35:rm.0 Request processed in 199us (396us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787787212.843844:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:1.0:1787787212.848094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.848207:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484713728 00000100:00100000:0.0:1787787212.848217:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484713728 00000100:00100000:0.0:1787787212.848289:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:0.0:1787787212.848402:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:10484:x1874630484713728:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1787787212.848426:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787212.848445:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b400/0x11620bc3f30a8f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80d2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.848558:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a8f33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.848574:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a8f33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.848588:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a8f33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787212.848609:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787787212.848708:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b400/0x11620bc3f30a8f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80d2 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.848726:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a8f33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80d2 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.848748:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:0.0:1787787212.848751:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787787212.848755:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a600, rc 0) 00000100:00100000:0.0:1787787212.848820:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484713728:12345-192.168.204.31@tcp:101:rm.0 Request processed in 421us (735us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787787212.853116:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:1.0:1787787212.855452:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.855647:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484713856 00000100:00100000:2.0:1787787212.855657:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484713856 00000100:00100000:2.0:1787787212.855729:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:2.0:1787787212.855739:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484713856:12345-192.168.204.31@tcp:41:rm.0 00000004:00000024:2.0:1787787212.855806:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787787212.855887:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484713856:12345-192.168.204.31@tcp:41:rm.0 Request processed in 148us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787212.855895:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:2.0:1787787212.863057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787212.863217:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484713984 00000100:00100000:3.0:1787787212.863228:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484713984 00000100:00100000:3.0:1787787212.863309:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:3.0:1787787212.863319:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f58583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484713984:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1787787212.863341:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787212.863702:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80d9 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863775:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863790:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863802:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863831:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863840:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863846:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863949:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863970:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.863978:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787212.864018:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787787212.864023:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787212.864043:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864055:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864063:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864069:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864085:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864091:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787212.864095:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864103:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864115:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:3.0:1787787212.864118:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787212.864123:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864129:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864199:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864206:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864213:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864218:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787212.864221:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864236:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864259:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff986fc3a1da00) 00010000:00010000:3.0:1787787212.864261:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787212.864265:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864272:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864588:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80d9 expref: 20 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864679:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80d9 expref: 19 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.864688:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787212.864691:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787212.864694:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:3.0:1787787212.864778:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f58583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:10484:x1874630484713984:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1459us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787212.864787:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:1.0:1787787212.871881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787212.872029:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484714240 00000100:00100000:2.0:1787787212.872041:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484714240 00000100:00100000:2.0:1787787212.872107:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:2.0:1787787212.872118:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:10484:x1874630484714240:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1787787212.872216:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787787212.872459:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a8f56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80d9 expref: 19 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872561:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b200/0x11620bc3f30a8f02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80bd expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872575:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787212.872586:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a8f17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80c4 expref: 17 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872742:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:2.0:1787787212.872747:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787212.872772:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872799:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872810:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872822:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872828:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872834:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872951:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872961:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.872968:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787212.874783:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787787212.874799:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357056659830ns, next at 358056656288ns, rc = 0 00010000:00010000:2.0:1787787212.874860:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.874875:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.874901:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.874910:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.874916:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.874922:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.874996:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787212.875020:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875027:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875034:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875040:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787212.875044:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875051:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875063:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787212.875066:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787787212.875078:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875084:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a8f6b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875107:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875113:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875118:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875123:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787212.875152:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875159:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875167:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:2.0:1787787212.875169:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787212.875173:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875178:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a8f5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787212.875189:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2ba1667 reply state 000000007462b59c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875212:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787212.875218:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787212.875221:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787212.875224:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787212.875335:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484714240:12345-192.168.204.31@tcp:36:rm.0 Request processed in 3216us (3462us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787787212.875351:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 38 00010000:00010000:3.0:1787787212.879462:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787212.879480:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.879493:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787212.879517:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.879528:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.879548:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787212.879552:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787787212.879557:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.879563:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a8f72 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787212.882109:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787212.882118:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787212.882121:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787212.887520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787212.887619:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484714496 00000100:00100000:0.0:1787787212.887629:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484714496 00000100:00100000:0.0:1787787212.887688:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:0.0:1787787212.887698:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484714496:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1787787212.887915:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:10484:x1874630484714496:12345-192.168.204.31@tcp:35:rm.0 Request processed in 218us (405us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787787212.887923:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:0.0:1787787212.902744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787212.902879:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484714752 00000100:00100000:3.0:1787787212.902891:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484714752 00000100:00100000:3.0:1787787212.902958:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:3.0:1787787212.902968:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c13261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:10484:x1874630484714752:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1787787212.903033:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787787212.903066:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a8f33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80d2 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903090:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a8ed1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80af expref: 18 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903102:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9870d4cec300) 00010000:00010000:3.0:1787787212.903120:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30a8e92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80a1 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903196:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d000) 00010000:00010000:3.0:1787787212.903216:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787212.903583:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903598:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903609:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903624:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903630:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903637:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903716:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903725:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903732:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787212.903970:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787787212.903985:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.903992:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904006:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904012:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787212.904016:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904023:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904032:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff986fc2a1d700) 00010000:00010000:3.0:1787787212.904035:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787787212.904039:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904046:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30a8f87 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904065:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904070:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904076:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904081:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787212.904083:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904099:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904107:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1dc00) 00010000:00010000:3.0:1787787212.904109:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787212.904112:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904118:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30a8f79 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787212.904183:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af351b4a reply state 0000000070b27633 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904195:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787212.904201:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff986fc2a1dd00) 00010000:00010000:3.0:1787787212.904204:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787212.904206:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787212.904930:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c13261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:10484:x1874630484714752:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1958us (2192us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787787212.904940:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00010000:00010000:3.0:1787787213.609469:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787214.187641:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787214.187665:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503668736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787214.187736:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787214.187804:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668736 00000100:00100000:0.0:1787787214.187812:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668736 00000100:00100000:0.0:1787787214.187856:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787787214.187866:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503668736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787214.187902:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787214.187960:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503668736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787214.187967:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787787214.188014:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503668736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787214.633354:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787787214.697411:0:9848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358879270029ns, next at 359879267069ns, rc = 0 00000100:00100000:1.0:1787787214.697479:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503668864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787214.697552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787214.697991:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503668992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787214.698024:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787214.698230:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668864 00000100:00100000:0.0:1787787214.698238:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668864 00000100:00100000:2.0:1787787214.698283:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503668992 00000100:00100000:2.0:1787787214.698288:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503668992 00000100:00100000:2.0:1787787214.698324:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787787214.698324:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787787214.698333:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503668992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787214.698336:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503668864:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1787787214.698361:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1787787214.698362:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787787214.698404:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503668992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787214.698404:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503668864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787214.698412:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787787214.698412:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1787787214.698476:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870f5858780 x1874630503668992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787214.698499:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503668992:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787787214.698514:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787214.698568:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503668864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787214.698662:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503669376:0@lo:400:kworker.0 00000100:00100000:1.0:1787787214.698704:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503669504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698710:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503669120:0@lo:400:kworker.0 00000100:00100000:1.0:1787787214.698733:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787214.698738:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787214.698751:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503670016:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698758:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503669632:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698778:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503669248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698820:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669120 00000100:00100000:3.0:1787787214.698823:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669120 00000100:00100000:3.0:1787787214.698851:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787787214.698857:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503669120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698890:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503669120:12345-0@lo:400:kworker.0 Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787214.698893:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787214.698897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787787214.698923:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787214.698941:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503669760:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698942:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669504 00000100:00100000:3.0:1787787214.698945:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669504 00000100:00100000:1.0:1787787214.698964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787214.698971:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503670016 00000100:00100000:3.0:1787787214.698974:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503670016 00000100:00100000:1.0:1787787214.698978:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503670272:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.698986:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669248 00000100:00100000:3.0:1787787214.698989:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669248 00000100:00100000:1.0:1787787214.698995:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787214.698999:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787787214.699004:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503669504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787214.699020:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787214.699025:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503670400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787214.699034:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503669504:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787214.699039:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787787214.699043:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787214.699051:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787787214.699056:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503670016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787214.699067:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669760 00000100:00100000:1.0:1787787214.699070:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669760 00000100:00100000:3.0:1787787214.699080:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503670016:12345-0@lo:400:kworker.0 Request processed in 24us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787214.699085:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787787214.699095:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787787214.699095:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503670272 00000100:00100000:1.0:1787787214.699097:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503670272 00000100:00100000:3.0:1787787214.699100:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503669248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787214.699116:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787214.699122:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503669760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.699125:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503669248:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787214.699135:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1787787214.699168:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787214.699171:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787214.699173:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787214.699198:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787787214.699217:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503670272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787214.699307:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503669504:0@lo:400:kworker.0 00000100:00100000:0.0:1787787214.699316:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503670016:0@lo:400:kworker.0 00000100:00100000:0.0:1787787214.699342:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503669248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787214.699373:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503670400 00000100:00100000:0.0:1787787214.699377:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503670400 00000100:00100000:0.0:1787787214.699398:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787787214.699404:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503670400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787214.699415:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787214.699416:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503670272:12345-0@lo:400:kworker.0 Request processed in 212us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787214.699422:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787787214.699440:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787214.699440:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503670400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787214.699446:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787787214.699455:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503670144:0@lo:400:kworker.0 00010000:00080000:0.0:1787787214.699468:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95d680 x1874630503670400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787214.699475:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787214.699492:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503670400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787214.699495:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5858780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503669120:0@lo:400:kworker.0 00010000:00080000:0.0:1787787214.699503:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418d2c0 x1874630503670272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787214.699511:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669632 00000100:00100000:0.0:1787787214.699511:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503670272:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.699513:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669632 00000100:00100000:3.0:1787787214.699536:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503670144 00000100:00100000:3.0:1787787214.699539:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503670144 00000100:00100000:3.0:1787787214.699554:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787787214.699560:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503669632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.699588:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503669632:12345-0@lo:400:kworker.0 Request processed in 29us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787214.699588:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503669760:12345-0@lo:400:kworker.0 Request processed in 466us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787214.699595:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787214.699630:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787787214.699638:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503670144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787214.699663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787214.699664:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503670144:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787214.699670:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787787214.699679:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669376 00000100:00100000:0.0:1787787214.699682:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669376 00000100:00100000:0.0:1787787214.699696:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787787214.699701:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503669376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787214.699726:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503669376:12345-0@lo:400:kworker.0 Request processed in 25us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787214.699731:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787787214.699739:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503669888:0@lo:400:kworker.0 00010000:00080000:0.0:1787787214.699753:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418f0c0 x1874630503669760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787214.699762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787214.699762:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503669760:0@lo:400:kworker.0 00000100:00100000:2.0:1787787214.699787:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503669376:0@lo:400:kworker.0 00000100:00080000:2.0:1787787214.699809:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787787214.699838:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418cf00 x1874630503669632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787214.699847:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503669632:0@lo:400:kworker.0 00010000:00080000:2.0:1787787214.699857:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418c780 x1874630503670144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787214.699863:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503670144:0@lo:400:kworker.0 00000100:00100000:3.0:1787787214.699906:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787787214.699913:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503669888 00000100:00100000:0.0:1787787214.699917:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503669888 00000100:00100000:0.0:1787787214.699961:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787787214.699967:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503669888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787214.700008:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503669888:12345-0@lo:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787214.700014:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787787214.700105:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787214.700122:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418de00 x1874630503669888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787214.700130:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503669888:0@lo:400:kworker.0 00010000:00010000:0.0:1787787215.664737:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787216.556564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787216.556622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787216.556650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787216.556685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787216.556720:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715008 00000100:00100000:1.0:1787787216.556721:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715136 00000100:00100000:2.0:1787787216.556731:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715008 00000100:00100000:1.0:1787787216.556731:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715136 00000100:00100000:3.0:1787787216.556794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484714880 00000100:00100000:2.0:1787787216.556797:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715392 00000100:00100000:3.0:1787787216.556801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484714880 00000100:00100000:2.0:1787787216.556802:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715392 00000100:00100000:3.0:1787787216.556840:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 336 00000100:00100000:3.0:1787787216.556851:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484714880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787216.556873:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 215 00000100:00100000:0.0:1787787216.556887:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2392:x1874630484715008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787216.556946:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484714880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787216.556954:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 336 00000100:00100000:1.0:1787787216.559350:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 216 00000100:00100000:1.0:1787787216.559369:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484715136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787216.560286:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787787216.560297:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1787787216.560319:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787216.560325:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787216.560473:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 217 00000100:00100000:2.0:1787787216.560483:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484715392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787216.562250:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2392:x1874630484715008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5359us (5688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787216.562262:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 215 00000100:00100000:3.0:1787787216.567077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787216.567348:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484715136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 7982us (10692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787216.567363:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 216 00000100:00100000:0.0:1787787216.568038:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715264 00000100:00100000:3.0:1787787216.568040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787216.568050:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715264 00000100:00100000:0.0:1787787216.568118:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:0.0:1787787216.568128:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484715264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787216.568214:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484715264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787216.568221:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00080000:2.0:1787787216.568269:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787216.568301:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484715392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 7818us (11613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787216.568310:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 217 00000100:00100000:2.0:1787787216.568328:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715520 00000100:00100000:2.0:1787787216.568332:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715520 00000100:00080000:2.0:1787787216.568362:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787216.568390:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 218 00000100:00100000:2.0:1787787216.568398:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484715520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787216.568430:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484715520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787216.568436:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 218 00010000:00010000:0.0:1787787216.682835:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787216.702978:0:13691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1787787217.258557:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787217.258581:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503670528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787217.258646:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.258721:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503670528 00000100:00100000:3.0:1787787217.258729:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503670528 00000100:00100000:3.0:1787787217.258777:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787787217.258787:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503670528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787217.258816:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787217.258860:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503670528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.258866:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787787217.258885:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787217.258913:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95da40 x1874630503670528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787217.258929:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503670528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787217.260265:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787217.260279:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503670656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787217.260327:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.260371:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503670656 00000100:00100000:1.0:1787787217.260378:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503670656 00000100:00100000:1.0:1787787217.260436:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787787217.260445:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5858780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503670656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787217.260460:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787217.260520:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5858780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503670656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.260527:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787787217.260582:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787217.260607:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95da40 x1874630503670656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787217.260635:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503670656:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1787787217.581476:0:13739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9b6774f0 20000000:00000080:0.0:1787787217.581493:0:13739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff986fc271f000 uarg=0000000000000000 20000000:01000000:0.0:1787787217.581534:0:13739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787787217.581540:0:13739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787787217.581544:0:13739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787787217.582036:0:13740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787787217.582388:0:13739:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787787217.587532:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787787217.587572:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787787217.587608:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787787217.587626:0:13739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787787217.587645:0:13739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587663:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587671:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587678:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587684:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587693:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587700:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587707:0:13739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587746:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.587973:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 12 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.588002:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c13252c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503670784:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787217.588794:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.588806:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.588817:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503670912:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787217.588868:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.588877:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 23 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.588886:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1326d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671040:0@lo:104: 00000100:00100000:0.0:1787787217.588921:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787217.588957:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.588965:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 23 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.588974:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671168:0@lo:104: 00010000:00010000:0.0:1787787217.589002:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.589010:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 23 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.589028:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c13243c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671296:0@lo:104: 00000100:00100000:2.0:1787787217.589235:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787787217.589255:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.589275:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.589285:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671040 00000100:00100000:2.0:1787787217.589290:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671040 00000100:00100000:2.0:1787787217.589326:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671168 00000100:00100000:2.0:1787787217.589329:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671168 00000100:00100000:2.0:1787787217.589339:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671296 00000100:00100000:2.0:1787787217.589341:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671296 00000100:00100000:2.0:1787787217.589354:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787217.589363:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3740850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+5:13739:x1874630503671040:12345-0@lo:104: 00010000:00010000:2.0:1787787217.589376:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589424:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787217.589430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3740850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+5:13739:x1874630503671040:12345-0@lo:104: Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.589437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787217.589472:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787217.589479:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:13739:x1874630503671168:12345-0@lo:104: 00010000:00010000:2.0:1787787217.589486:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589549:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787787217.589554:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+4:13739:x1874630503671168:12345-0@lo:104: Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.589560:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787217.589574:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787217.589580:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:13739:x1874630503671296:12345-0@lo:104: 00010000:00010000:2.0:1787787217.589588:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589619:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787787217.589624:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:13739:x1874630503671296:12345-0@lo:104: Request processed in 45us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.589630:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787787217.589649:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787787217.589655:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589662:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787217.589666:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589675:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787217.589682:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787217.589689:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787217.589722:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589729:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787217.589748:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589755:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30a8e45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e4c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589767:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787217.589770:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589774:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787217.589777:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589783:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787217.589789:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787217.589794:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787217.589806:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589812:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787217.589818:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589834:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee3200/0x11620bc3f30a8e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589843:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787217.589846:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589851:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787217.589854:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589861:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787217.589867:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787217.589872:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787217.589886:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589891:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787217.589907:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589913:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30a8e29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e30 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.589922:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.589928:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.589930:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.589937:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787217.589955:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503671424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787217.589986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.590015:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787217.590020:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503671552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787217.590039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.590201:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503671680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787217.590227:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.590257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671424 00000100:00100000:2.0:1787787217.590262:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671424 00010000:00010000:2.0:1787787217.590280:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 24 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.590294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671552 00000100:00100000:2.0:1787787217.590297:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671552 00010000:00010000:2.0:1787787217.590307:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 25 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.590316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671680 00000100:00100000:2.0:1787787217.590318:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671680 00010000:00010000:2.0:1787787217.590327:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 26 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.590338:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787217.590344:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+26:3653:x1874630503671424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787217.590354:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787217.590359:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 26 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.590374:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 26 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.590390:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787217.590417:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+26:3653:x1874630503671424:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.590424:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787217.590436:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787787217.590441:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+25:3653:x1874630503671552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787217.590448:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787217.590452:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 25 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.590459:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 25 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.590468:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787217.590488:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+25:3653:x1874630503671552:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.590494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787787217.590505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787787217.590511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503671680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787217.590518:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787217.590522:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 24 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.590529:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 24 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.590545:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787217.590569:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503671680:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.590575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787787217.590608:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503671680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787217.590642:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503671552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787217.590648:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503671424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787217.590714:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.590723:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 23 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.590733:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1325680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671808:0@lo:104: 00000100:00100000:0.0:1787787217.590758:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787217.590785:0:13739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc1086c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787787217.590798:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c7000/0x11620bc3f30a8e4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8e45 expref: 23 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.590809:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1326d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671040:0@lo:104: 00010000:00010000:0.0:1787787217.590825:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6400/0x11620bc3f30a8e3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8e37 expref: 22 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.590833:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671168:0@lo:104: 00010000:00010000:0.0:1787787217.590842:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30a8e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8e29 expref: 21 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.590849:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c13243c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671296:0@lo:104: 00010000:00010000:1.0:1787787217.590953:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787217.591663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671808 00000100:00100000:2.0:1787787217.591669:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671808 00000100:00100000:2.0:1787787217.591775:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787217.591786:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1327840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:13739:x1874630503671808:12345-0@lo:104: 00010000:00010000:2.0:1787787217.591798:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.591869:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787217.591875:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1327840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:697ab143-19fe-4215-afba-68a282afbaf6+3:13739:x1874630503671808:12345-0@lo:104: Request processed in 92us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.591881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787787217.591902:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787217.591909:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.591917:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787217.591921:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.591949:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.591953:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1325680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503671808:0@lo:104: 10000000:00010000:2.0:1787787217.591958:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787217.591965:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787217.591993:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.591999:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787217.592034:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.592041:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c7a00/0x11620bc3f30a8e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a8e22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.592096:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503671936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787217.592130:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787217.592169:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.592174:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.592175:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787217.592557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503671936 00000100:00100000:0.0:1787787217.592563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503671936 00010000:00010000:0.0:1787787217.592587:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 21 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.592619:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787217.592636:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+21:3656:x1874630503671936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787217.592647:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787217.592652:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 21 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.592663:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 21 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.592677:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5200/0x11620bc3f30a8e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a8e1b expref: 21 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.592690:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787217.592721:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+20:3656:x1874630503671936:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.592728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787217.593196:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503671936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787217.596431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787217.596933:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c13252c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503670784:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787217.597326:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715648 00000100:00100000:3.0:1787787217.597334:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715648 00010000:00010000:3.0:1787787217.597384:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 13 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.597453:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:3.0:1787787217.597464:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484715648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787217.597480:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787217.597486:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 13 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.597499:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 13 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.597516:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2200/0x11620bc3f30a8e5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8093 expref: 13 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.597529:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787217.598232:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:2391:x1874630484715648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 767us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.598242:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:1.0:1787787217.601380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787217.601510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715776 00000100:00100000:2.0:1787787217.601518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715776 00010000:00010000:2.0:1787787217.601552:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.601588:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:2.0:1787787217.601597:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:2392:x1874630484715776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787217.601612:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787217.601617:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601644:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 12 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601664:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601673:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601688:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601695:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601702:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601709:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601715:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787217.601719:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601727:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601735:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.601755:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787217.601809:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:2392:x1874630484715776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 213us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.601818:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00010000:00010000:0.0:1787787217.601927:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8bc00/0x11620bc3f30a8e53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c808c expref: 11 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.601941:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1874630503670912:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787217.601976:0:13739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.601986:0:13739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.601992:0:13739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.601999:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8a600/0x11620bc3f30a8f8e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.707293:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787787218.391961:0:13788:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff12e9d980 20000000:00000080:1.0:1787787218.391980:0:13788:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff986fc3741400 uarg=0000000000000000 20000000:01000000:1.0:1787787218.392019:0:13788:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787787218.392025:0:13788:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787787218.392030:0:13788:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787787218.393564:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1787787218.393721:0:13788:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787787218.393809:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000004:00080000:3.0:1787787218.396688:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787787218.396731:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1787787218.396742:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787787218.396812:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396825:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396833:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396839:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787218.396843:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396851:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396868:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787218.396871:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787218.396876:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396883:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a8ee6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396900:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396917:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396923:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396927:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787218.396930:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396936:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396945:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787218.396947:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787218.396950:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396956:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a8efb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.396986:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397001:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397007:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397013:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787218.397021:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397027:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397035:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787218.397038:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787218.397040:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397046:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3c00/0x11620bc3f30a8f64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397060:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397067:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397072:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397077:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787218.397080:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397085:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397091:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff986fc2a1dd00) 00010000:00010000:2.0:1787787218.397093:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787218.397103:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.397108:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8f80 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787218.397562:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787218.397587:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503672064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787787218.397652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787218.397796:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672064 00000100:00100000:1.0:1787787218.397805:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672064 00000100:00100000:1.0:1787787218.397871:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787218.397882:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503672064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787787218.397906:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787787218.397935:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f77cc, atime: 0x6a8f77cc, ctime: 0x6a8f77cc, blocks: 0x0 00010000:00010000:1.0:1787787218.397942:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.397955:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1787787218.397977:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787218.397983:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787787218.398096:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787787218.398498:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.398510:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.398517:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.398542:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787787218.398747:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503672064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 867us (1093us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787787218.398755:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787787218.398806:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787218.398813:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.398820:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787218.398824:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.398833:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.398851:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.398858:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047f27108/0x11620bc3f30a8f95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787218.398879:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787218.398881:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787218.398883:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787218.399314:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1787787218.399349:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1787787218.399640:0:13788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787787218.399658:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399672:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399681:0:13788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399688:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399703:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399709:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399715:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787218.399718:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399726:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399735:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399742:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787218.399749:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30a8f9c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787787218.407585:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9870fc3061c0/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787787218.407603:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503672064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787787218.603862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787218.603940:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484715904 00000100:00100000:3.0:1787787218.603950:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484715904 00000100:00100000:3.0:1787787218.604057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 337 00000100:00100000:3.0:1787787218.604066:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:6164:x1874630484715904:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787218.604084:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787218.604104:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0031200/0x11620bc3f30a8fa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787218.604167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0031200/0x11620bc3f30a8fa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80e0 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787218.604179:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0031200/0x11620bc3f30a8fa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80e0 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787218.604196:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031200, rc 0) 00000100:00100000:3.0:1787787218.604254:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484715904:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 189us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787218.604261:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 337 00000100:00100000:1.0:1787787218.610569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787218.610856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716032 00000100:00100000:3.0:1787787218.610868:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716032 00000100:00100000:3.0:1787787218.610927:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 338 00000100:00100000:3.0:1787787218.610939:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484716032:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787218.611111:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484716032:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 174us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787218.611119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 338 00000100:00100000:1.0:1787787218.613680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787218.613856:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716160 00000100:00100000:3.0:1787787218.613867:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716160 00000100:00100000:3.0:1787787218.613930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 339 00000100:00100000:3.0:1787787218.613941:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484716160:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787218.614079:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484716160:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 139us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787218.614087:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 339 00000100:00100000:1.0:1787787218.619726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787218.619943:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716288 00000100:00100000:3.0:1787787218.619954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716288 00000100:00100000:3.0:1787787218.620008:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 340 00000100:00100000:3.0:1787787218.620018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:10769:x1874630484716288:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787218.620534:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:10769:x1874630484716288:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 516us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787218.620542:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 340 00000100:00100000:1.0:1787787218.624843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787218.625192:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716416 00000100:00100000:0.0:1787787218.625202:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716416 00000100:00100000:0.0:1787787218.625374:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 341 00000100:00100000:0.0:1787787218.625385:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:10769:x1874630484716416:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787218.625545:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:10769:x1874630484716416:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 161us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787218.625553:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 341 00000100:00100000:1.0:1787787218.631650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787218.632216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716544 00000100:00100000:3.0:1787787218.632228:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716544 00000100:00100000:3.0:1787787218.632361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00100000:3.0:1787787218.632371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:6164:x1874630484716544:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787218.632388:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787218.632408:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0030600/0x11620bc3f30a8faa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80e7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787218.632455:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0030600/0x11620bc3f30a8faa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80e7 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787218.632468:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0030600/0x11620bc3f30a8faa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80e7 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787218.632477:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030600, rc 0) 00000100:00100000:3.0:1787787218.632537:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484716544:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 167us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787218.632544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00100000:2.0:1787787218.641110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787218.642301:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716672 00000100:00100000:0.0:1787787218.642315:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716672 00000100:00100000:0.0:1787787218.642376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:0.0:1787787218.642387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484716672:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787218.642534:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484716672:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 149us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787218.642541:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:1.0:1787787218.646987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787218.647426:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716800 00000100:00100000:3.0:1787787218.647437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716800 00000100:00100000:2.0:1787787218.647644:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 344 00000100:00100000:2.0:1787787218.647655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484716800:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787218.647810:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:6164:x1874630484716800:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 156us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787218.647817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 344 00000100:00100000:1.0:1787787218.653377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787218.654107:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484716928 00000100:00100000:2.0:1787787218.654119:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484716928 00000100:00100000:2.0:1787787218.654219:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 345 00000100:00100000:2.0:1787787218.654229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:10772:x1874630484716928:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787218.654590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:10772:x1874630484716928:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 361us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787218.654598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 345 00000100:00100000:1.0:1787787218.657492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787218.657632:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717056 00000100:00100000:0.0:1787787218.657641:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717056 00000100:00100000:0.0:1787787218.657826:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 346 00000100:00100000:0.0:1787787218.657837:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:10772:x1874630484717056:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787218.658035:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:10772:x1874630484717056:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 200us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787218.658044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 346 00010000:00010000:2.0:1787787218.731229:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787787219.177423:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787219.177432:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f5ba1800 from 7 10000000:01000000:1.0:1787787219.177437:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787219.177491:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.177514:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.177525:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787219.177552:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.177675:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.177743:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787219.178004:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672192 00000100:00100000:2.0:1787787219.178013:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672192 00000100:00100000:2.0:1787787219.178068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787787219.178087:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+20:6524:x1874630503672192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787219.178100:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787219.178113:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3c00/0x11620bc3f30a8fb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8fb1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787219.178167:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3c00/0x11620bc3f30a8fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8fb1 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787219.178179:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3c00/0x11620bc3f30a8fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8fb1 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787219.178188:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3c00, rc 0) 00000100:00100000:2.0:1787787219.178237:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503672192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.178256:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787787219.178263:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787219.178276:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.178284:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787219.178340:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.178367:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.178394:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787219.178409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672320 00000100:00100000:3.0:1787787219.178414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672320 00000100:00100000:3.0:1787787219.178447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787787219.178455:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503672320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787219.178574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503672320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787219.178580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787787219.178599:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.178625:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.178734:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.178757:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787219.178809:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672448 00000100:00100000:0.0:1787787219.178819:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672448 00000100:00100000:0.0:1787787219.178851:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787787219.178858:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503672448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.178934:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503672448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.178941:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787787219.179430:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.187117:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13801:1874630503672576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.187915:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.188088:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787219.188624:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672576 00000100:00100000:2.0:1787787219.188633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672576 00000100:00100000:2.0:1787787219.188862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787787219.188873:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:13801:x1874630503672576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787219.189014:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+21:13801:x1874630503672576:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.189022:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787787219.189247:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13801:1874630503672576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787219.189276:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787219.189286:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.189289:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787787219.189296:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870f5ba1800 00000020:00000080:1.0:1787787219.189298:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787787219.189361:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787219.189365:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.189366:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787787219.189369:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787219.189371:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.189373:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787787219.189376:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870f5ba1800 00000020:00000080:1.0:1787787219.189378:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787787219.189425:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13801:1874630503672704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.189463:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.197284:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672704 00000100:00100000:1.0:1787787219.197328:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787219.197789:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672704 00000100:00100000:0.0:1787787219.197979:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787787219.197991:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:13801:x1874630503672704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787219.198195:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+21:13801:x1874630503672704:12345-0@lo:502:llog_process_th.0 Request processed in 207us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.198204:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787787219.199844:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13801:1874630503672704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787219.199884:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787219.199892:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.199894:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787787219.199904:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787787219.200789:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787787219.200813:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787219.200825:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.200837:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787219.200848:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787219.200850:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc17b800 from 7 10000000:01000000:0.0:1787787219.200853:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787219.200888:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.200897:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.200918:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787219.200942:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1325e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.201016:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.202075:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787219.204547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672832 00000100:00100000:2.0:1787787219.204563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672832 00000100:00100000:1.0:1787787219.207948:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787787219.207971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+21:6524:x1874630503672832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787219.207990:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787219.208007:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a8fc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8fbf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.208046:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a8fc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8fbf expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.208057:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a8fc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8fbf expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.208066:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4400, rc 0) 00000100:00100000:1.0:1787787219.208746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503672832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 784us (7728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.208754:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787787219.214633:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1325e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787219.214662:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787219.215434:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787219.215647:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787219.215912:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787219.215946:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.216019:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503672960 00000100:00100000:1.0:1787787219.216027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503672960 00000100:00100000:1.0:1787787219.217630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787787219.217648:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503672960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787219.222179:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503672960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787219.222239:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.222266:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503672960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4622us (6351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.222279:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787787219.222311:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787219.222346:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.222395:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673088 00000100:00100000:1.0:1787787219.222402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673088 00000100:00100000:1.0:1787787219.222451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787787219.222460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503673088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.222569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503673088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.222576:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787787219.222628:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.222817:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13804:1874630503673216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.222852:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.222872:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673216 00000100:00100000:1.0:1787787219.222875:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673216 00000100:00100000:1.0:1787787219.222891:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787787219.222896:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:13804:x1874630503673216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.222956:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:13804:x1874630503673216:12345-0@lo:502:llog_process_th.0 Request processed in 59us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.222963:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787787219.222986:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.222996:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13804:1874630503673216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787219.223014:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787219.223023:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.223025:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787787219.223044:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870fc17b800 00000020:00000080:1.0:1787787219.223047:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787787219.223100:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787219.223104:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.223105:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787787219.223108:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787219.223110:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.223112:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787787219.223131:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870fc17b800 00000020:00000080:1.0:1787787219.223134:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787787219.223200:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13804:1874630503673344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.223230:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.223248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673344 00000100:00100000:1.0:1787787219.223251:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673344 00000100:00100000:1.0:1787787219.223267:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787787219.223272:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:13804:x1874630503673344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.223322:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:13804:x1874630503673344:12345-0@lo:502:llog_process_th.0 Request processed in 49us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.223328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787787219.223350:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.223360:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13804:1874630503673344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787219.223375:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787219.223378:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787219.223380:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787787219.223383:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787787219.223431:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787787219.223457:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787219.223467:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223477:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787219.223488:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787219.223490:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870d2373000 from 7 10000000:01000000:1.0:1787787219.223493:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787219.223516:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223529:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223539:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787219.223551:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.223575:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.223588:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.223599:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673472 00000100:00100000:1.0:1787787219.223602:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673472 00000100:00100000:1.0:1787787219.223618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787787219.223623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+22:6524:x1874630503673472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787219.223631:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787219.223641:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8fd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8fcd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223660:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8fd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8fcd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223671:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8fd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8fcd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223679:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5400, rc 0) 00000100:00100000:1.0:1787787219.223705:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503673472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.223710:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787787219.223742:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787219.223753:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.223762:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787219.223798:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.223820:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.223832:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.223843:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673600 00000100:00100000:1.0:1787787219.223846:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673600 00000100:00100000:1.0:1787787219.223862:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787787219.223868:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503673600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.223940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503673600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.223946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787787219.223969:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.223990:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.224019:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.224031:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.224040:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673728 00000100:00100000:1.0:1787787219.224043:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673728 00000100:00100000:1.0:1787787219.224057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787787219.224062:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503673728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.224131:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503673728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.224165:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787787219.224199:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503673728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787219.224426:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13805:1874630503673856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787219.224458:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.224476:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673856 00000100:00100000:1.0:1787787219.224480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673856 00000100:00100000:1.0:1787787219.224498:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787787219.224504:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:13805:x1874630503673856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787219.228967:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e870c0 going to sleep for 11 seconds 00000040:00080000:0.0:1787787219.229938:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787219.230788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+23:13805:x1874630503673856:12345-0@lo:502:llog_process_th.0 Request processed in 6277us (6323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.230799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787787219.231619:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13805:1874630503673856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787219.231657:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787219.231667:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787219.231670:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787787219.231678:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870d2373000 00000020:00000080:2.0:1787787219.231681:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787219.231744:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787219.231749:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787219.231750:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787787219.231753:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787219.231756:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787219.231757:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787787219.231761:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870d2373000 00000020:00000080:2.0:1787787219.231763:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787787219.231819:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13805:1874630503673984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787219.231885:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787219.231920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503673984 00000100:00100000:2.0:1787787219.231932:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503673984 00000100:00100000:2.0:1787787219.231976:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787787219.231985:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:13805:x1874630503673984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787219.232585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+23:13805:x1874630503673984:12345-0@lo:502:llog_process_th.0 Request processed in 599us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.232594:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787787219.232640:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3761a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787219.232654:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13805:1874630503673984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787219.232675:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787219.232681:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787219.232682:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787787219.232687:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787787219.233317:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787787219.233336:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787219.233346:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.233357:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787219.233368:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787219.233372:0:6524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3240800 from 7 10000000:01000000:1.0:1787787219.233374:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787219.233406:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.233414:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787219.233424:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787219.233455:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503674112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.233733:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.233808:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c7e87d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787219.233898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674112 00000100:00100000:1.0:1787787219.233904:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674112 00000100:00100000:0.0:1787787219.235451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787787219.235464:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+23:6524:x1874630503674112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787219.235481:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787219.235508:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc2a8b400/0x11620bc3f30a8fe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a8fdb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.235537:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc2a8b400/0x11620bc3f30a8fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a8fdb expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.235549:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc2a8b400/0x11620bc3f30a8fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a8fdb expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.235559:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b400, rc 0) 00000100:00100000:0.0:1787787219.235622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503674112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.235639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787787219.235707:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503674112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787219.235725:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787219.235736:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787219.235817:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503674240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.235851:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.235882:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870ffa31000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787219.235896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674240 00000100:00100000:0.0:1787787219.235900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674240 00000100:00100000:0.0:1787787219.235925:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787787219.235932:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503674240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.236051:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503674240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.236058:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787787219.236089:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503674240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.236133:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503674368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.236207:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.236227:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870ffa31000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787219.236237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674368 00000100:00100000:0.0:1787787219.236240:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674368 00000100:00100000:0.0:1787787219.236263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787787219.236278:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503674368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.236355:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:6524:x1874630503674368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.236362:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787787219.236405:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:697ab143-19fe-4215-afba-68a282afbaf6:6524:1874630503674368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787219.236623:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13808:1874630503674496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787219.236668:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.236692:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870ffa319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787219.236695:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674496 00000100:00100000:2.0:1787787219.236701:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674496 00000100:00100000:2.0:1787787219.236735:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787787219.236744:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:13808:x1874630503674496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787219.236938:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:13808:x1874630503674496:12345-0@lo:502:llog_process_th.0 Request processed in 195us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.236945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787787219.236975:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13808:1874630503674496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787219.236999:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787219.237008:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787219.237011:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787219.237019:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870c3240800 00000020:00000080:0.0:1787787219.237023:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787219.237293:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787219.237299:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787219.237301:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787219.237304:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787219.237307:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787219.237308:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787787219.237314:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870c3240800 00000020:00000080:0.0:1787787219.237317:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787787219.237357:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13808:1874630503674624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787219.237398:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.237418:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870ffa319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787219.238028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674624 00000100:00100000:2.0:1787787219.238100:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674624 00000100:00100000:2.0:1787787219.238277:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787787219.238288:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:13808:x1874630503674624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787219.238388:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:13808:x1874630503674624:12345-0@lo:502:llog_process_th.0 Request processed in 102us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.238395:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787787219.238617:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:697ab143-19fe-4215-afba-68a282afbaf6:13808:1874630503674624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787219.238648:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787219.238654:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787219.238656:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787787219.238660:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787787219.238897:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787787219.238933:0:6524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787219.238943:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787219.238953:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787219.240782:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787219.305388:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503674752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787219.305466:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.306577:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674752 00000100:00100000:0.0:1787787219.306588:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674752 00000100:00100000:0.0:1787787219.306635:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787787219.306645:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503674752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787219.306678:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787219.306741:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503674752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.306748:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787787219.307498:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503674752:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787787219.753288:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787219.817824:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503674880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787219.817902:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.817965:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503675392:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818017:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.818047:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1326580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503675904:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818071:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.818100:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787787219.818117:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c13252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503675008:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818159:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.818175:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1326d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503675520:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818196:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.818216:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503676032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.818264:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675392 00000100:00100000:1.0:1787787219.818272:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675392 00000100:00100000:1.0:1787787219.818322:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675904 00000100:00100000:1.0:1787787219.818325:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675904 00000100:00100000:1.0:1787787219.818341:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675008 00000100:00100000:1.0:1787787219.818343:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675008 00000100:00100000:1.0:1787787219.818353:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675520 00000100:00100000:1.0:1787787219.818355:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675520 00000100:00100000:1.0:1787787219.818367:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676032 00000100:00100000:1.0:1787787219.818369:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676032 00000100:00100000:1.0:1787787219.818413:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787787219.818422:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503675392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818599:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503675392:12345-0@lo:400:kworker.0 Request processed in 177us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.818607:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787787219.818624:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787787219.818631:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503675904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818660:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503675904:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.818665:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787787219.818675:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787787219.818681:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503675008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818705:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503675008:12345-0@lo:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.818711:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787787219.818721:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787787219.818727:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503675520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818753:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503675520:12345-0@lo:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.818758:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787787219.818769:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787787219.818775:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503676032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818802:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503676032:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.818807:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1787787219.818834:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787219.818838:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787219.818865:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c13252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503675008:0@lo:400:kworker.0 00010000:00080000:1.0:1787787219.818879:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c1326d00 x1874630503675520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787219.818889:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1326d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503675520:0@lo:400:kworker.0 00010000:00080000:1.0:1787787219.818898:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4170000 x1874630503676032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787219.818905:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503676032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818914:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503675392:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.818922:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1326580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503675904:0@lo:400:kworker.0 00000100:00100000:0.0:1787787219.819341:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503674880 00000100:00100000:0.0:1787787219.819348:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503674880 00000100:00100000:0.0:1787787219.819377:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787219.819397:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503674880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787219.819426:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787219.819580:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503676544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787219.819601:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503674880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 216us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.819610:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787787219.819632:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.819665:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676544 00000100:00100000:0.0:1787787219.819669:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676544 00000100:00100000:3.0:1787787219.819683:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787219.819692:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503676416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787219.819709:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787219.819719:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503676544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787219.819726:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787787219.819744:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787219.819772:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676416 00000100:00100000:3.0:1787787219.819777:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676416 00000100:00100000:0.0:1787787219.819788:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503676544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787219.819802:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787787219.819812:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787787219.819815:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503676416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787219.819830:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787787219.819847:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787219.819862:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503676416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787219.819870:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787787219.819903:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503676416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787219.819915:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503676544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787219.820118:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1325680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503675136:0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820180:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787219.820202:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503675648:0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820228:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.820239:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675136 00000100:00100000:0.0:1787787219.820244:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675136 00000100:00100000:2.0:1787787219.820258:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503676160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787219.820273:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787787219.820285:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503675136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787219.820312:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787787219.820321:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c13243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503675264:0@lo:400:kworker.0 00000100:00100000:0.0:1787787219.820331:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503675136:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.820337:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787787219.820350:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.820373:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675264 00000100:00100000:0.0:1787787219.820378:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675264 00000100:00100000:2.0:1787787219.820387:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1325e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503675776:0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787219.820427:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787787219.820434:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503676288:0@lo:400:kworker.0 00000100:00100000:0.0:1787787219.820438:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503675264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820476:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787219.820657:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503674880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787219.820704:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675648 00000100:00100000:1.0:1787787219.820708:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675648 00000100:00100000:1.0:1787787219.820732:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676160 00000100:00100000:1.0:1787787219.820735:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676160 00000100:00100000:1.0:1787787219.820747:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503675776 00000100:00100000:1.0:1787787219.820750:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503675776 00000100:00100000:3.0:1787787219.820757:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676288 00000100:00100000:3.0:1787787219.820763:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676288 00000100:00100000:1.0:1787787219.820767:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787787219.820777:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503675648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787219.820791:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787787219.820800:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503676160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820836:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1325680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503675136:0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820868:0:9030:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787787219.820876:0:9030:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787787219.820890:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787787219.820898:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787787219.820905:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503675776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820942:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503675776:12345-0@lo:400:kworker.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.820948:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787787219.820960:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787787219.820966:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787787219.820970:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503676288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.820995:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503676288:12345-0@lo:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787219.821000:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1787787219.821097:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c1325e00 x1874630503675776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787219.821120:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1325e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503675776:0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.821132:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503676288:0@lo:400:kworker.0 00000100:00080000:2.0:1787787219.821272:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787219.824480:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503676160:12345-0@lo:400:kworker.0 Request processed in 3678us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787219.824492:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787219.824633:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503675264:12345-0@lo:400:kworker.0 Request processed in 4197us (4281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787219.824643:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787787219.824750:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c13243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503675264:0@lo:400:kworker.0 00000100:00100000:2.0:1787787219.824763:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503676160:0@lo:400:kworker.0 00000100:00100000:1.0:1787787219.825337:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503675648:12345-0@lo:400:kworker.0 Request processed in 4559us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787219.825346:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1787787219.827889:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c1324b40 x1874630503675648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787219.827910:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503675648:0@lo:400:kworker.0 00000040:00080000:0.0:1787787220.265877:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787787220.267027:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787220.779881:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787221.686768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787221.686888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787221.686922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787221.686956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787221.686981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787221.687007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787221.687036:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717568 00000100:00100000:1.0:1787787221.687046:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717568 00000100:00100000:1.0:1787787221.687121:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:1.0:1787787221.687175:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484717568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787221.687319:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717440 00000100:00100000:0.0:1787787221.687324:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717440 00000100:00100000:0.0:1787787221.687358:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717696 00000100:00100000:0.0:1787787221.687361:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717696 00000100:00100000:0.0:1787787221.687375:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717312 00000100:00100000:0.0:1787787221.687378:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717312 00000100:00100000:0.0:1787787221.687391:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717824 00000100:00100000:0.0:1787787221.687393:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717824 00000100:00100000:0.0:1787787221.687409:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 225 00000100:00100000:0.0:1787787221.687418:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484717440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787221.687452:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484717568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 280us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787221.687461:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:0.0:1787787221.687469:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484717440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787221.687476:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 225 00000100:00100000:0.0:1787787221.687492:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 226 00000100:00100000:0.0:1787787221.687500:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484717696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787221.687527:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484717696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787221.687534:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 226 00000100:00100000:3.0:1787787221.687702:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 227 00000100:00100000:3.0:1787787221.687713:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484717312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787221.687752:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484717312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787221.687759:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 228 00000100:00100000:0.0:1787787221.687768:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484717824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787221.687797:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484717824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (789us total) trans 0 rc 0/0 00000100:00080000:1.0:1787787221.687868:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787221.687872:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787221.687875:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787221.689922:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717184 00000100:00100000:2.0:1787787221.689939:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717184 00000100:00100000:2.0:1787787221.690007:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 367 00000100:00100000:2.0:1787787221.690017:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484717184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787221.690110:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484717184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787221.690118:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 367 00000100:00100000:3.0:1787787221.690752:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 227 00000100:00100000:0.0:1787787221.690762:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 228 00010000:00010000:2.0:1787787221.801334:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787222.377377:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503676672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787222.377451:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787222.377753:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787222.377763:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503676800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787222.377789:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787222.377923:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676672 00000100:00100000:0.0:1787787222.377931:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676672 00000100:00100000:0.0:1787787222.378088:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676800 00000100:00100000:0.0:1787787222.378092:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676800 00000100:00080000:1.0:1787787222.378164:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787222.381833:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787222.381862:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503676672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787222.381903:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787222.382162:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503676672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 314us (4709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787222.382171:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787222.382199:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787787222.382207:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503676800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787222.382220:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787222.382249:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503676800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787222.382255:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1787787222.382748:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed921680 x1874630503676800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787222.382774:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503676800:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787787222.382789:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a04f00 x1874630503676672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787222.382801:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503676672:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787787222.825505:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787223.849576:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787787223.916877:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1787787224.425424:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787224.425451:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503676928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787224.425533:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787224.425698:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503676928 00000100:00100000:0.0:1787787224.425719:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503676928 00000100:00100000:0.0:1787787224.425834:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787787224.425846:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503676928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787224.425891:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787224.425952:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503676928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787224.425976:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787787224.426241:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503676928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787787224.873363:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787224.938368:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503677312:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938495:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503677824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938518:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938534:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503678336:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938553:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938573:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787787224.938578:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff959680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503677184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938605:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938624:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503677696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938678:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503678208:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938732:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503678720:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787224.938779:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677312 00000100:00100000:2.0:1787787224.938788:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677312 00000100:00100000:2.0:1787787224.938830:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677824 00000100:00100000:2.0:1787787224.938833:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677824 00000100:00100000:2.0:1787787224.938854:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678336 00000100:00100000:2.0:1787787224.938857:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678336 00000100:00100000:2.0:1787787224.938874:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787787224.938882:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503677312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.938934:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503677312:12345-0@lo:400:kworker.0 Request processed in 52us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787224.938955:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787787224.938974:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787787224.938980:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503677824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939019:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503677824:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787224.939026:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787787224.939037:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787787224.939043:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503678336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939072:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503678336:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787224.939078:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787787224.939100:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677696 00000100:00100000:2.0:1787787224.939104:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677696 00000100:00100000:2.0:1787787224.939125:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787224.939131:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503677696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939206:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503677696:12345-0@lo:400:kworker.0 Request processed in 74us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787224.939213:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787224.939252:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503677696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939265:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503677312:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939273:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503677824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939280:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503678336:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939347:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678208 00000100:00100000:2.0:1787787224.939356:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678208 00000100:00100000:2.0:1787787224.939380:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678720 00000100:00100000:2.0:1787787224.939383:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678720 00000100:00100000:2.0:1787787224.939401:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787787224.939407:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503678208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939443:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503678208:12345-0@lo:400:kworker.0 Request processed in 35us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787224.939449:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1787787224.939471:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4ed2940 x1874630503678208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787224.939481:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503678208:0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939497:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787787224.939504:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503678720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787224.939536:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503678720:12345-0@lo:400:kworker.0 Request processed in 33us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787224.939541:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787787224.939560:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787787224.939565:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9870fc3061c0, transno 4294967301 00000100:00100000:2.0:1787787224.939574:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503678720:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.939925:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503677056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787224.939959:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.939980:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503677568:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940001:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.940028:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503678080:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940048:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.940062:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503678592:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940079:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.940107:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787787224.940113:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503677440:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940134:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.940165:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503677952:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940186:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.940203:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503678464:0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940223:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787224.940242:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677056 00000100:00100000:3.0:1787787224.940247:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677056 00000100:00100000:3.0:1787787224.940265:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677440 00000100:00100000:3.0:1787787224.940268:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677440 00000100:00100000:3.0:1787787224.940279:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787787224.940286:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1874630503677056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787224.940311:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787224.940348:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1874630503677056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787224.940355:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787787224.940369:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787787224.940374:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503677440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940402:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503677440:12345-0@lo:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787224.940408:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787787224.940424:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677568 00000100:00100000:3.0:1787787224.940428:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677568 00000100:00100000:3.0:1787787224.940443:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677952 00000100:00100000:3.0:1787787224.940446:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677952 00000100:00100000:3.0:1787787224.940457:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678464 00000100:00100000:3.0:1787787224.940459:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678464 00000100:00100000:3.0:1787787224.940483:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787787224.940489:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503677568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940518:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503677568:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787224.940524:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787787224.940535:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787787224.940541:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503677952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940568:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503677952:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787224.940574:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787787224.940585:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787787224.940591:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503678464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787224.940616:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503678464:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787224.940622:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787787224.940656:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503678848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787224.940682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787224.940801:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503677184 00000100:00100000:0.0:1787787224.940806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503677184 00000100:00100000:0.0:1787787224.940833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787787224.940840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503677184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787224.940875:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503677184:12345-0@lo:400:kworker.0 Request processed in 35us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787224.940881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787787224.941068:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff959680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503677184:0@lo:400:kworker.0 00000100:00080000:1.0:1787787224.941159:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787224.941164:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787224.941166:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787224.941169:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787224.941186:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678080 00000100:00100000:1.0:1787787224.941190:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678080 00000100:00100000:1.0:1787787224.941222:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678592 00000100:00100000:1.0:1787787224.941225:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678592 00000100:00100000:1.0:1787787224.941240:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787224.941245:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503678080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787224.941276:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503678080:12345-0@lo:400:kworker.0 Request processed in 31us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787224.941282:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787224.941293:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787224.941298:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503678592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787224.941318:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503678592:12345-0@lo:400:kworker.0 Request processed in 21us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787224.941324:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1787787224.941442:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787224.941444:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787224.945252:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503677440:0@lo:400:kworker.0 00010000:00080000:0.0:1787787224.945274:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4ed0780 x1874630503677952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787224.945286:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503677952:0@lo:400:kworker.0 00010000:00080000:0.0:1787787224.945298:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f79e00 x1874630503678464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787224.945305:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503678464:0@lo:400:kworker.0 00000100:00100000:0.0:1787787224.945322:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503677056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787224.945334:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503677568:0@lo:400:kworker.0 00010000:00080000:0.0:1787787224.945345:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4ed3480 x1874630503678080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787224.945354:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503678080:0@lo:400:kworker.0 00000100:00100000:0.0:1787787224.945365:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503678592:0@lo:400:kworker.0 00000100:00100000:0.0:1787787224.945405:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787224.945433:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503678976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787224.945492:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787224.945540:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678848 00000100:00100000:0.0:1787787224.945547:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678848 00000100:00100000:0.0:1787787224.945586:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503678976 00000100:00100000:0.0:1787787224.945590:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503678976 00000100:00100000:0.0:1787787224.945604:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787787224.945611:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503678848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787224.945640:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787224.945680:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503678848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787224.945686:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787787224.945720:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787224.945727:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed921a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503678976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787224.945737:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787224.945767:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed921a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503678976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787224.945772:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787224.945805:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503678976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787224.950219:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503678848:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787225.897586:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787226.796334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787226.796375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787226.796409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787226.796445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787226.796462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787226.796485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787226.796512:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718080 00000100:00100000:1.0:1787787226.796521:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718080 00000100:00100000:1.0:1787787226.796572:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718592 00000100:00100000:1.0:1787787226.796575:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718592 00000100:00100000:1.0:1787787226.796587:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718208 00000100:00100000:1.0:1787787226.796590:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718208 00000100:00100000:1.0:1787787226.796618:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718464 00000100:00100000:1.0:1787787226.796634:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718464 00000100:00100000:1.0:1787787226.796654:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 235 00000100:00100000:1.0:1787787226.796663:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484718080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787226.796739:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484718080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787226.796746:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 235 00000100:00100000:1.0:1787787226.796762:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 236 00000100:00100000:1.0:1787787226.796768:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484718592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787226.796790:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484718592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787226.796796:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 236 00000100:00100000:1.0:1787787226.796807:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 237 00000100:00100000:1.0:1787787226.796813:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484718208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787226.796837:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484718208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787226.796842:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 237 00000100:00100000:1.0:1787787226.796853:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 238 00000100:00100000:1.0:1787787226.796860:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484718464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787226.796884:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484718464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787226.796890:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 238 00000100:00080000:1.0:1787787226.796909:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787226.796913:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787226.797357:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718336 00000100:00100000:2.0:1787787226.797364:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718336 00000100:00100000:2.0:1787787226.797407:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:2.0:1787787226.797415:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484718336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787226.797446:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484718336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787226.797464:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00080000:2.0:1787787226.797487:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787226.797502:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484717952 00000100:00100000:2.0:1787787226.797505:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484717952 00000100:00100000:2.0:1787787226.797529:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 369 00000100:00100000:2.0:1787787226.797535:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484717952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787226.797559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d15da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484717952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787226.797565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 369 00010000:00010000:1.0:1787787226.922119:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787227.497538:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787227.497563:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503679104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787227.497633:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787227.497752:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679104 00000100:00100000:0.0:1787787227.497760:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679104 00000100:00100000:0.0:1787787227.497831:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787227.497840:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503679104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787227.497869:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787227.497916:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503679104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787227.497923:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1787787227.498094:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787227.498122:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed920780 x1874630503679104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787227.498166:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503679104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787227.498318:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787227.498329:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503679232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787227.498361:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787227.498440:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679232 00000100:00100000:3.0:1787787227.498444:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679232 00000100:00100000:3.0:1787787227.498490:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787787227.498498:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503679232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787227.498510:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787227.498543:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503679232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787227.498557:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1787787227.498616:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787227.498636:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a05a40 x1874630503679232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787227.498649:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503679232:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787787227.945319:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787228.973223:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787229.547697:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787229.547722:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed922940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503679360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787229.547805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787229.547976:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679360 00000100:00100000:3.0:1787787229.547985:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679360 00000100:00100000:3.0:1787787229.548047:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787787229.548056:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503679360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787229.548091:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787787229.548168:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503679360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787229.548174:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787787229.548286:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed922940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503679360:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787229.995359:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787230.057557:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503679872:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.057695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787230.057762:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503680384:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.057796:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787230.057798:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503679744:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.057819:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503680896:0@lo:400:kworker.0 00000100:00100000:1.0:1787787230.057842:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787230.057877:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503680128:0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.057901:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503679488:0@lo:400:kworker.0 00000100:00100000:1.0:1787787230.057919:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787230.057940:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503680640:0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.057970:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787230.057986:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787230.058012:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503680000:0@lo:400:kworker.0 00000100:00100000:1.0:1787787230.058013:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503681152:0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.058053:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787230.058059:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787230.058079:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503680512:0@lo:400:kworker.0 00000100:00100000:1.0:1787787230.058104:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680384 00000100:00100000:3.0:1787787230.058111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787230.058114:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680384 00000100:00100000:3.0:1787787230.058133:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503681024:0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.058182:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787230.058219:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679488 00000100:00100000:1.0:1787787230.058220:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679744 00000100:00100000:3.0:1787787230.058224:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679488 00000100:00100000:1.0:1787787230.058226:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679744 00000100:00100000:1.0:1787787230.058256:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680000 00000100:00100000:1.0:1787787230.058259:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680000 00000100:00100000:0.0:1787787230.058268:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679872 00000100:00100000:3.0:1787787230.058272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787787230.058275:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679872 00000100:00100000:1.0:1787787230.058280:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787787230.058286:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503679488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787230.058293:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503680384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.058307:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680128 00000100:00100000:0.0:1787787230.058312:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680128 00000100:00100000:0.0:1787787230.058332:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787787230.058341:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503679872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.058356:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503679488:12345-0@lo:400:kworker.0 Request processed in 72us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787230.058359:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503680384:12345-0@lo:400:kworker.0 Request processed in 70us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787230.058368:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787787230.058372:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787787230.058395:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787787230.058404:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc403ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.058422:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787787230.058511:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503679872:12345-0@lo:400:kworker.0 Request processed in 172us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787230.058518:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787787230.058533:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787787230.058539:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503680128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.058550:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.058678:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503680128:12345-0@lo:400:kworker.0 Request processed in 138us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787230.058685:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787787230.058706:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503679616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787230.058736:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787230.058755:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff959680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503680256:0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.058776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787230.058784:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503680768:0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.058800:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787230.058899:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680640 00000100:00100000:2.0:1787787230.058904:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680640 00000100:00100000:0.0:1787787230.058946:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503681280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787230.058969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787230.058986:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787230.058992:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503681408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787230.059085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787230.059165:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503679616 00000100:00100000:0.0:1787787230.059176:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503679616 00000100:00100000:2.0:1787787230.059181:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681152 00000100:00100000:2.0:1787787230.059187:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681152 00000100:00100000:0.0:1787787230.059208:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681408 00000100:00100000:2.0:1787787230.059213:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680512 00000100:00100000:0.0:1787787230.059213:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681408 00000100:00100000:2.0:1787787230.059219:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680512 00000100:00100000:0.0:1787787230.059236:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787787230.059243:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681024 00000100:00100000:0.0:1787787230.059247:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503679616:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787230.059249:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681024 00000100:00100000:2.0:1787787230.059267:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787787230.059276:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503680640:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787787230.059276:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787230.059331:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503679616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787230.059335:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503680640:12345-0@lo:400:kworker.0 Request processed in 58us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787230.059342:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787787230.059347:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787787230.059365:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787787230.059371:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503681152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.059396:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503681152:12345-0@lo:400:kworker.0 Request processed in 26us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787230.059401:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787787230.059411:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787787230.059417:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503680512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.059571:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787230.059579:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed921e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503681408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787230.059589:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787230.059624:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed921e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503681408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787230.059631:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787230.059647:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681280 00000100:00100000:0.0:1787787230.059651:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681280 00000100:00100000:0.0:1787787230.059667:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787787230.059673:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed923840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503681280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787230.059697:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787787230.059721:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503680512:12345-0@lo:400:kworker.0 Request processed in 302us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787230.059738:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed923840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503681280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787230.059741:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787230.059751:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787787230.059761:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787787230.059769:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503681024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.059808:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503681024:12345-0@lo:400:kworker.0 Request processed in 38us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787230.059813:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787787230.059841:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787230.059870:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503679872:0@lo:400:kworker.0 00010000:00080000:2.0:1787787230.059883:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff958780 x1874630503680384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787230.059893:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503680384:0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.059940:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503681408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787230.059965:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680256 00000100:00100000:0.0:1787787230.059965:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503679616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787230.059972:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680256 00000100:00100000:0.0:1787787230.059982:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503681280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787230.059993:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680768 00000100:00100000:2.0:1787787230.059998:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680768 00000100:00100000:2.0:1787787230.060019:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503680896 00000100:00100000:2.0:1787787230.060022:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503680896 00000100:00100000:2.0:1787787230.060040:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787787230.060048:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503680256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060089:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503680256:12345-0@lo:400:kworker.0 Request processed in 42us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787230.060089:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1787787230.060096:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787787230.060108:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787787230.060114:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503680768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060160:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503680768:12345-0@lo:400:kworker.0 Request processed in 47us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787230.060171:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787787230.060184:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787787230.060190:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503680896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060224:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503680896:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787230.060229:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:2.0:1787787230.060260:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4ed2940 x1874630503680896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787230.060271:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503680896:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060300:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff959680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503680256:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060311:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503680768:0@lo:400:kworker.0 00000100:00100000:0.0:1787787230.060345:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00010000:00080000:2.0:1787787230.060354:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4ed3480 x1874630503680512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787230.060363:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503680512:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060372:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503681024:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060381:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503679488:0@lo:400:kworker.0 00000100:00080000:2.0:1787787230.060425:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787230.060501:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787230.060504:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787230.060506:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787230.060540:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503680128:0@lo:400:kworker.0 00010000:00080000:2.0:1787787230.060557:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4ed03c0 x1874630503680640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787230.060638:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503680640:0@lo:400:kworker.0 00000100:00100000:2.0:1787787230.060657:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503681152:0@lo:400:kworker.0 00000100:00100000:1.0:1787787230.062366:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc403ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503679744:12345-0@lo:400:kworker.0 Request processed in 3954us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787230.062381:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787787230.062459:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503679744:0@lo:400:kworker.0 00000100:00100000:3.0:1787787230.064032:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503680000:12345-0@lo:400:kworker.0 Request processed in 5593us (5970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787230.064047:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787787230.064631:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503680000:0@lo:400:kworker.0 00000040:00080000:3.0:1787787230.506435:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787787230.507068:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787787231.017316:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787231.920812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787231.920852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787231.920892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787231.920976:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718976 00000100:00100000:3.0:1787787231.920987:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718976 00000100:00100000:3.0:1787787231.921053:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718848 00000100:00100000:3.0:1787787231.921056:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718848 00000100:00100000:3.0:1787787231.921079:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 245 00000100:00100000:3.0:1787787231.921090:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484718976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787231.921204:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484718976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 115us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787231.921212:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 245 00000100:00100000:3.0:1787787231.921229:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 246 00000100:00100000:3.0:1787787231.921236:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484718848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787231.921262:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484718848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787231.921268:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 246 00000100:00100000:0.0:1787787231.921483:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484718720 00000100:00100000:0.0:1787787231.921487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484718720 00000100:00100000:0.0:1787787231.921529:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 371 00000100:00100000:0.0:1787787231.921536:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484718720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787231.921561:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484718720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787231.921567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 371 00000100:00080000:1.0:1787787231.921905:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787231.921910:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787231.937903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787231.937946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787231.937981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787231.938055:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719360 00000100:00100000:3.0:1787787231.938064:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719360 00000100:00100000:0.0:1787787231.938164:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719232 00000100:00100000:3.0:1787787231.938171:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 247 00000100:00100000:0.0:1787787231.938171:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719232 00000100:00100000:3.0:1787787231.938184:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484719360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787231.938211:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 248 00000100:00100000:0.0:1787787231.938221:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484719232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787231.938263:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484719360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787231.938267:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484719232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787231.938276:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 248 00000100:00100000:3.0:1787787231.938295:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 247 00000100:00080000:1.0:1787787231.938462:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787231.938467:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787231.939781:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719104 00000100:00100000:2.0:1787787231.939794:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719104 00000100:00100000:2.0:1787787231.939946:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:2.0:1787787231.939957:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2390:x1874630484719104:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:2.0:1787787231.939985:0:13816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8f09 00000100:00080000:2.0:1787787231.939995:0:13816:0:(import.c:65:import_set_state_nolock()) ffff986fc341c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787231.940053:0:13816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1787787231.940262:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+2:2390:x1874630484719104:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 306us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787231.940270:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00010000:00010000:0.0:1787787231.940701:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787231.940852:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787787232.046132:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787232.618014:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787787232.618038:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503681664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787232.618109:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787232.618198:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503681536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787232.618230:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787232.618351:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681664 00000100:00100000:3.0:1787787232.618372:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681664 00000100:00100000:3.0:1787787232.618436:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681536 00000100:00100000:3.0:1787787232.618439:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681536 00000100:00100000:3.0:1787787232.618459:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787787232.618467:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503681664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787232.618496:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787232.618537:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503681664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787232.618556:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787787232.618572:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787787232.618579:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503681536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787232.618588:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787232.618622:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503681536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787232.618629:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787787232.618660:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787232.618934:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed920000 x1874630503681664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787232.618954:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503681664:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787787232.618966:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a05a40 x1874630503681536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787232.618978:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503681536:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787787233.065887:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787234.089366:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787234.666478:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503681792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787234.666551:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787234.666685:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681792 00000100:00100000:0.0:1787787234.666694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681792 00000100:00100000:0.0:1787787234.666743:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787787234.666751:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5940b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503681792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787234.666785:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787234.666857:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5940b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503681792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787234.666864:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787787234.666956:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503681792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787235.114306:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787235.177396:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503681920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787235.177480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.178154:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870f5941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503682048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787235.178196:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787235.178201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.178216:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503682176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787235.178256:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682048 00000100:00100000:2.0:1787787235.178263:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682048 00000100:00100000:1.0:1787787235.178268:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.178322:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787787235.178332:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503682048:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787235.178338:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503681920 00000100:00100000:1.0:1787787235.178343:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503681920 00000004:00000024:2.0:1787787235.178369:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787787235.178377:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682176 00000100:00100000:1.0:1787787235.178380:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682176 00000100:00100000:1.0:1787787235.178398:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787787235.178405:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503681920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787235.178425:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787235.178438:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503682048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.178446:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787787235.178466:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503681920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.178472:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787787235.178487:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787787235.178505:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5943840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503682176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787235.178515:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787235.178542:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5943840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503682176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.178548:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787787235.178585:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503682176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787235.178785:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870f5941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503682048:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787787235.178823:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787235.179044:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503682304:0@lo:400:kworker.0 00000100:00100000:1.0:1787787235.179088:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.179117:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503682816:0@lo:400:kworker.0 00000100:00100000:1.0:1787787235.179164:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.179189:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503683328:0@lo:400:kworker.0 00000100:00100000:1.0:1787787235.179207:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.179221:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787787235.179225:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed922940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503682688:0@lo:400:kworker.0 00000100:00100000:1.0:1787787235.179252:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.179265:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503683200:0@lo:400:kworker.0 00000100:00100000:1.0:1787787235.179284:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.179302:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682688 00000100:00100000:1.0:1787787235.179306:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682688 00000100:00100000:1.0:1787787235.179414:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787787235.179422:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503682688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787235.179458:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503682688:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.179464:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787787235.179485:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed922940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503682688:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.179663:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683200 00000100:00100000:0.0:1787787235.179667:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683200 00000100:00100000:2.0:1787787235.179787:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682304 00000100:00100000:2.0:1787787235.179793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682304 00000100:00100000:0.0:1787787235.179801:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787787235.179822:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503683200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.179840:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787787235.179849:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503682304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.179869:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503683200:12345-0@lo:400:kworker.0 Request processed in 61us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.179878:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787787235.179893:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d5a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503682304:12345-0@lo:400:kworker.0 Request processed in 44us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.179901:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00080000:0.0:1787787235.179916:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed922d00 x1874630503683200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787235.179928:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503683200:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.179937:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503682304:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.179954:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682816 00000100:00100000:0.0:1787787235.179957:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682816 00000100:00100000:0.0:1787787235.179982:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683328 00000100:00100000:0.0:1787787235.179985:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683328 00000100:00100000:0.0:1787787235.180002:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787787235.180007:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5942940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503682816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.180052:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5942940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503682816:12345-0@lo:400:kworker.0 Request processed in 45us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.180060:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787787235.180075:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787787235.180081:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5941e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503683328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.180107:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5941e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503683328:12345-0@lo:400:kworker.0 Request processed in 26us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.180113:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503682560:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.180114:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787787235.180166:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503682816:0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.180192:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503683328:0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180206:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503683072:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.180213:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682560 00000100:00100000:0.0:1787787235.180217:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682560 00000100:00100000:2.0:1787787235.180238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.180260:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787787235.180264:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787787235.180269:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503682560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180275:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503682432:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.180306:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503682560:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.180315:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.180338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503682944:0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180373:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.180390:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503683456:0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180412:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.180435:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503682560:0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180456:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683072 00000100:00100000:2.0:1787787235.180467:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683072 00000100:00100000:0.0:1787787235.180474:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787787235.180502:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787787235.180509:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503683072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180545:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503683072:12345-0@lo:400:kworker.0 Request processed in 37us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.180551:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682432 00000100:00100000:2.0:1787787235.180554:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787787235.180557:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682432 00000100:00100000:0.0:1787787235.180575:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503682944 00000100:00100000:0.0:1787787235.180578:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503682944 00000100:00100000:2.0:1787787235.180582:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683456 00000100:00100000:2.0:1787787235.180587:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683456 00000100:00100000:0.0:1787787235.180596:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787787235.180604:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503682432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787787235.180627:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503682944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180667:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503682944:12345-0@lo:400:kworker.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.180673:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787787235.180684:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787787235.180690:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503683456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787235.180716:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503683456:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.180721:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787787235.180743:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503682432:12345-0@lo:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.180750:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503682432:0@lo:400:kworker.0 00000100:00100000:0.0:1787787235.180753:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00010000:00080000:2.0:1787787235.180767:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed9230c0 x1874630503682944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787235.180779:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503682944:0@lo:400:kworker.0 00010000:00080000:2.0:1787787235.180789:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed9203c0 x1874630503683456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787235.180798:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503683456:0@lo:400:kworker.0 00000100:00080000:1.0:1787787235.180858:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787235.180863:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787235.180865:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787235.181504:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed921680 x1874630503683072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787235.181516:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503683072:0@lo:400:kworker.0 00000100:00100000:3.0:1787787235.182090:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503681920:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787787236.140011:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787237.035612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787237.035662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787237.035734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719488 00000100:00100000:3.0:1787787237.035754:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719488 00000100:00100000:0.0:1787787237.035760:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719616 00000100:00100000:0.0:1787787237.035766:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719616 00000100:00100000:3.0:1787787237.035827:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 373 00000100:00100000:0.0:1787787237.035841:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 255 00000100:00100000:3.0:1787787237.035842:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484719488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787237.035855:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484719616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:1.0:1787787237.035961:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787237.036099:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484719616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 246us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787237.036107:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 255 00000100:00100000:3.0:1787787237.037978:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484719488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2134us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787237.037992:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 373 00000100:00100000:1.0:1787787237.038697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787237.038741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787237.038847:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719744 00000100:00100000:0.0:1787787237.038856:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719744 00000100:00100000:0.0:1787787237.038954:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 256 00000100:00100000:0.0:1787787237.038965:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484719744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787237.039038:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484719744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787237.039045:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 256 00000100:00080000:2.0:1787787237.039221:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787237.039393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787237.040976:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484719872 00000100:00100000:2.0:1787787237.040991:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484719872 00000100:00100000:2.0:1787787237.041164:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720000 00000100:00100000:2.0:1787787237.041170:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720000 00000100:00100000:3.0:1787787237.041229:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 257 00000100:00100000:3.0:1787787237.041240:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484719872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787237.041313:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484719872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787237.041321:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 257 00000100:00080000:1.0:1787787237.041707:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787237.041724:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787237.043637:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 258 00000100:00100000:2.0:1787787237.043652:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484720000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787237.043742:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484720000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787237.043750:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 258 00010000:00010000:0.0:1787787237.163206:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787237.738972:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503683584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787237.739124:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787237.739711:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683584 00000100:00100000:1.0:1787787237.739721:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683584 00000100:00100000:1.0:1787787237.739791:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787787237.739801:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503683584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787237.739833:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787787237.739884:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787237.739893:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503683584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787237.739901:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1787787237.739945:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed920f00 x1874630503683584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787237.739966:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503683584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787237.742637:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503683712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787237.742711:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787237.742865:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683712 00000100:00100000:1.0:1787787237.742874:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683712 00000100:00100000:1.0:1787787237.742960:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787787237.742969:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503683712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787237.742992:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787787237.743075:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787237.743519:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503683712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 551us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787237.743528:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1787787237.743593:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a06d00 x1874630503683712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787237.743613:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503683712:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787787237.743934:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:0.0:1787787237.743940:0:9520:0:(genops.c:885:class_export_put()) final put ffff986fc341b800/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:2.0:1787787237.745628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc341b800/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-OST0001 00000020:00000080:2.0:1787787237.745701:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc341c800 for lustre-OST0001 00010000:00010000:1.0:1787787238.185471:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787239.212327:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787239.785687:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503683840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787239.785773:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787239.785867:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683840 00000100:00100000:3.0:1787787239.785876:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683840 00000100:00100000:3.0:1787787239.785923:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787787239.785932:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503683840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787239.785964:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787787239.790440:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503683840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4500us (4658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787239.790455:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787787239.790608:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503683840:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787240.233366:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787240.297563:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787240.297587:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503683968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787240.297657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787240.297759:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503683968 00000100:00100000:0.0:1787787240.297768:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503683968 00000100:00100000:0.0:1787787240.297818:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787240.297828:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed922d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503683968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787240.297856:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787240.297896:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed922d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503683968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787240.297904:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787240.297955:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503683968:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787787240.298013:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787240.298593:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503684096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787240.298636:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.298826:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684096 00000100:00100000:3.0:1787787240.298831:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684096 00000100:00100000:3.0:1787787240.298868:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787787240.298877:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503684096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787240.298907:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787240.298947:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503684096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.298961:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787787240.298983:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503684352:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299013:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299032:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503684864:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299053:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299078:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503685376:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299100:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299119:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787787240.299124:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503684224:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299181:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299202:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503684736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299223:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299239:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503685248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299256:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299279:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503684608:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299313:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503685120:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299366:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503684096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787240.299380:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787787240.299386:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503684480:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299407:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299424:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503684992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299485:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503685504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787240.299534:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684608 00000100:00100000:3.0:1787787240.299538:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684608 00000100:00100000:3.0:1787787240.299559:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787787240.299566:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1324b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503684608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299605:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1324b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503684608:12345-0@lo:400:kworker.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.299612:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787787240.299631:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684352 00000100:00100000:3.0:1787787240.299634:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684352 00000100:00100000:3.0:1787787240.299652:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684864 00000100:00100000:3.0:1787787240.299655:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684864 00000100:00100000:3.0:1787787240.299676:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685376 00000100:00100000:3.0:1787787240.299679:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685376 00000100:00100000:3.0:1787787240.299693:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684736 00000100:00100000:3.0:1787787240.299695:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684736 00000100:00100000:3.0:1787787240.299705:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685248 00000100:00100000:3.0:1787787240.299707:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685248 00000100:00100000:3.0:1787787240.299729:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684480 00000100:00100000:3.0:1787787240.299731:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684480 00000100:00100000:3.0:1787787240.299742:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787787240.299748:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503684352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299783:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503684352:12345-0@lo:400:kworker.0 Request processed in 35us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.299789:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787787240.299802:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787787240.299808:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503684864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299843:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503684864:12345-0@lo:400:kworker.0 Request processed in 36us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.299849:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787787240.299863:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787787240.299870:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503685376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299895:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503685376:12345-0@lo:400:kworker.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.299900:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787787240.299910:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787787240.299915:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503684736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299935:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503684736:12345-0@lo:400:kworker.0 Request processed in 21us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.299940:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787787240.299948:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787787240.299953:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503685248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.299971:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503685248:12345-0@lo:400:kworker.0 Request processed in 19us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.299976:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787787240.299984:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787787240.299989:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c13243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503684480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300010:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c13243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503684480:12345-0@lo:400:kworker.0 Request processed in 21us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.300015:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787787240.300036:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684224 00000100:00100000:3.0:1787787240.300040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684224 00000100:00100000:3.0:1787787240.300070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787787240.300075:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503684224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300120:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3656:x1874630503684224:12345-0@lo:400:kworker.0 Request processed in 44us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.300126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787787240.300197:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685120 00000100:00100000:3.0:1787787240.300202:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685120 00000100:00100000:3.0:1787787240.300226:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503684992 00000100:00100000:3.0:1787787240.300229:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503684992 00000100:00100000:3.0:1787787240.300248:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685504 00000100:00100000:3.0:1787787240.300250:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685504 00000100:00100000:3.0:1787787240.300265:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787787240.300270:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503685120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300300:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503685120:12345-0@lo:400:kworker.0 Request processed in 30us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.300305:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787787240.300316:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787787240.300322:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503684992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300346:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503684992:12345-0@lo:400:kworker.0 Request processed in 25us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.300351:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787787240.300361:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787787240.300367:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1325680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503685504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300392:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1325680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503685504:12345-0@lo:400:kworker.0 Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787240.300397:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787787240.300435:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787240.300445:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787240.300448:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787240.300450:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787240.300490:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503684480:0@lo:400:kworker.0 00010000:00080000:3.0:1787787240.300504:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95c3c0 x1874630503684992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787240.300515:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503684992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300525:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503685504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300534:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503684608:0@lo:400:kworker.0 00010000:00080000:3.0:1787787240.300543:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95f840 x1874630503685120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787240.300552:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503685120:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300583:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503684224:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300592:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503684736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300601:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503685248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787240.300609:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503684352:0@lo:400:kworker.0 00010000:00080000:3.0:1787787240.300619:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95fc00 x1874630503684864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787240.300629:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503684864:0@lo:400:kworker.0 00010000:00080000:3.0:1787787240.300639:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36eda40 x1874630503685376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787240.300647:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503685376:0@lo:400:kworker.0 00000100:00100000:1.0:1787787240.301908:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503685632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787240.301968:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787240.302053:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685632 00000100:00100000:0.0:1787787240.302061:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685632 00000100:00100000:0.0:1787787240.302104:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787787240.302113:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503685632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787240.302131:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787240.302191:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503685632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787240.302199:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787787240.302398:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503685632:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787787240.745890:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787787240.753304:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787241.262615:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787242.160225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787242.160278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787242.160301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787242.160323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787242.160358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787242.160402:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720384 00000100:00100000:1.0:1787787242.160411:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720384 00000100:00100000:1.0:1787787242.160468:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720640 00000100:00100000:1.0:1787787242.160471:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720640 00000100:00100000:1.0:1787787242.160490:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720256 00000100:00100000:1.0:1787787242.160492:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720256 00000100:00100000:1.0:1787787242.160505:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720512 00000100:00100000:1.0:1787787242.160507:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720512 00000100:00100000:1.0:1787787242.160522:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 265 00000100:00100000:1.0:1787787242.160531:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484720384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787242.160605:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484720384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.160612:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 265 00000100:00100000:1.0:1787787242.160629:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 266 00000100:00100000:1.0:1787787242.160635:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484720640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787242.160659:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484720640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.160665:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 266 00000100:00100000:1.0:1787787242.160690:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 267 00000100:00100000:1.0:1787787242.160697:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484720256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787242.160723:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484720256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.160728:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 267 00000100:00100000:1.0:1787787242.160741:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 268 00000100:00100000:1.0:1787787242.160746:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484720512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787242.160807:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484720512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.160813:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 268 00000100:00080000:1.0:1787787242.160840:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787242.160844:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787242.161213:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720128 00000100:00100000:2.0:1787787242.161219:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720128 00000100:00100000:2.0:1787787242.161263:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 375 00000100:00100000:2.0:1787787242.161272:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484720128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787242.161308:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484720128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787242.161314:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 375 00010000:00010000:1.0:1787787242.281359:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787242.857972:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503685760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787242.858046:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787242.858332:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503685888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787242.858363:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787242.858448:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685760 00000100:00100000:2.0:1787787242.858458:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685760 00000100:00100000:2.0:1787787242.858513:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503685888 00000100:00100000:2.0:1787787242.858516:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503685888 00000100:00100000:2.0:1787787242.858535:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787787242.858542:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503685760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787242.858572:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787242.858615:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503685760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787242.858623:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787787242.858641:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787242.858648:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503685888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787242.858658:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787242.858697:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503685888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787242.858730:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787787242.859114:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787242.859172:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c1324f00 x1874630503685888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787242.859191:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503685888:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787787242.859377:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed9212c0 x1874630503685760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787242.859391:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503685760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787787243.305938:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787243.886716:0:14069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:34:02 (1787787242) 00010000:00010000:1.0:1787787244.329496:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787244.905696:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787244.905721:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503686016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787244.905797:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787244.905962:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686016 00000100:00100000:2.0:1787787244.905971:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686016 00000100:00100000:2.0:1787787244.906021:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787787244.906029:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503686016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787244.906074:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787244.906125:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503686016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787244.906132:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787787244.906230:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503686016:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787245.361275:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787245.417479:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787245.417506:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c13252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503686400:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417595:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.417630:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1326580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503686528:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417670:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503686272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787245.417672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787245.417706:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.417708:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503687040:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417736:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503686912:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.417741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787245.417769:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787245.417785:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503687424:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417808:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.417832:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503687552:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417835:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787787245.417843:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503686784:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417873:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.417879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787245.417892:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503687296:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.417911:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787787245.417920:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503686144:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.417920:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.417958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787245.417960:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686528 00000100:00100000:0.0:1787787245.417969:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686528 00000100:00100000:3.0:1787787245.417981:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503686656:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.418003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787245.418014:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686272 00000100:00100000:3.0:1787787245.418017:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff95f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503687168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.418026:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686272 00000100:00100000:3.0:1787787245.418036:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.418054:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503687680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787245.418054:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787787245.418068:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503686528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.418077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787245.418108:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687040 00000100:00100000:3.0:1787787245.418111:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687040 00000100:00100000:3.0:1787787245.418168:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687552 00000100:00100000:3.0:1787787245.418172:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687552 00000100:00100000:0.0:1787787245.418180:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503686528:12345-0@lo:400:kworker.0 Request processed in 114us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787245.418188:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787787245.418340:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687168 00000100:00100000:3.0:1787787245.418343:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687168 00000100:00100000:3.0:1787787245.418355:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687680 00000100:00100000:3.0:1787787245.418357:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687680 00000100:00100000:3.0:1787787245.418369:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787787245.418375:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503687040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.418405:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503687040:12345-0@lo:400:kworker.0 Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.418410:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787787245.418420:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787787245.418425:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503687552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.418445:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503687552:12345-0@lo:400:kworker.0 Request processed in 20us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.418451:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787787245.418461:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787787245.418467:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503687168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.418487:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503687168:12345-0@lo:400:kworker.0 Request processed in 20us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.418492:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787787245.418501:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787787245.418507:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503687680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.418535:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686400 00000100:00100000:1.0:1787787245.418539:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686400 00000100:00100000:1.0:1787787245.418576:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686912 00000100:00100000:1.0:1787787245.418579:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686912 00000100:00100000:1.0:1787787245.418595:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687424 00000100:00100000:1.0:1787787245.418597:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687424 00000100:00100000:3.0:1787787245.418609:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503687680:12345-0@lo:400:kworker.0 Request processed in 101us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.418622:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686784 00000100:00100000:1.0:1787787245.418626:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686784 00000100:00100000:3.0:1787787245.418636:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787787245.418647:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687296 00000100:00100000:1.0:1787787245.418651:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687296 00000100:00100000:3.0:1787787245.418663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686144 00000100:00100000:3.0:1787787245.418668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686144 00000100:00100000:1.0:1787787245.418679:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503686656 00000100:00100000:1.0:1787787245.418685:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503686656 00000100:00100000:3.0:1787787245.418696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787787245.418706:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503686144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.418711:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787787245.418722:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503686400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.418739:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503686144:12345-0@lo:400:kworker.0 Request processed in 35us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.418769:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503686400:12345-0@lo:400:kworker.0 Request processed in 49us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.418775:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787787245.418789:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787787245.418795:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503686912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.418830:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503686912:12345-0@lo:400:kworker.0 Request processed in 35us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.418836:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787787245.418846:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffad4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503687808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787245.418853:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787787245.418859:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed922940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503687424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787245.418891:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787245.418896:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed922940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503687424:12345-0@lo:400:kworker.0 Request processed in 36us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.418904:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787787245.418921:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787787245.418927:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503686784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787245.418934:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687808 00000100:00100000:2.0:1787787245.418938:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687808 00000100:00100000:1.0:1787787245.418960:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503686784:12345-0@lo:400:kworker.0 Request processed in 33us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.418968:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787787245.418972:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787787245.418981:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503687808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787245.418987:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787787245.418996:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503687296:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787787245.419003:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787245.419027:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503687296:12345-0@lo:400:kworker.0 Request processed in 33us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.419041:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787787245.419050:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503687808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.419057:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787787245.419058:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787787245.419068:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503686656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787245.419106:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffad4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503687808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787245.419119:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503686656:12345-0@lo:400:kworker.0 Request processed in 52us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.419127:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787787245.419206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:3.0:1787787245.419245:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787245.419249:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787245.419251:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787245.419253:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787245.419413:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787787245.419424:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503686272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787245.419450:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787787245.419478:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787245.419489:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503686272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.419491:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffad43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503687936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787245.419547:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503686784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.419556:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503687296:0@lo:400:kworker.0 00010000:00080000:1.0:1787787245.419583:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95fc00 x1874630503686912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787245.419597:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503686912:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.419599:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787787245.419622:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95c3c0 x1874630503687424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787245.419632:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503687424:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.419646:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503687936 00000100:00100000:3.0:1787787245.419650:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503687936 00000100:00100000:1.0:1787787245.419651:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c13252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503686400:0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.419670:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503686272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787245.419680:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787787245.419688:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503687936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787245.419698:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787245.419727:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1324f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503686144:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.419733:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503687936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.419741:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787787245.419747:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503686656:0@lo:400:kworker.0 00010000:00080000:1.0:1787787245.419758:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95f480 x1874630503687168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787245.419766:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503687168:0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.419786:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc356b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503687680:0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.419795:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1326580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503686528:0@lo:400:kworker.0 00010000:00080000:1.0:1787787245.419805:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ff95da40 x1874630503687040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787245.419814:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff95da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503687040:0@lo:400:kworker.0 00000100:00100000:1.0:1787787245.419829:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503687552:0@lo:400:kworker.0 00000100:00100000:3.0:1787787245.419839:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffad43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503687936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787245.424940:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787787245.854913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787245.855017:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720768 00000100:00100000:3.0:1787787245.855027:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720768 00000100:00100000:3.0:1787787245.855109:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00080000:0.0:1787787245.855116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787245.855163:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:11063:x1874630484720768:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787245.855184:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787245.855205:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80ee expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787245.855271:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a8ff0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787245.855285:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787245.855298:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787245.855348:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787245.855352:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787245.855391:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787245.855418:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a8fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80ee expref: 7 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787245.855439:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a8ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80ee expref: 6 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787245.855447:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1cd00) 00010000:00010000:3.0:1787787245.855450:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787245.855453:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:3.0:1787787245.855519:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:11063:x1874630484720768:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 386us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.855535:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:2.0:1787787245.870102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787245.870256:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484720896 00000100:00100000:1.0:1787787245.870266:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484720896 00000100:00100000:1.0:1787787245.870353:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:1.0:1787787245.870363:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:11064:x1874630484720896:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787245.870382:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787245.870401:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a8ff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80f5 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870465:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870479:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870490:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870503:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870527:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870534:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870598:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30a900c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870617:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30a900c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870624:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30a900c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787245.870661:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787787245.870665:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787245.870686:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30a900c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870696:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870702:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870709:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870715:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787245.870718:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870732:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870744:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1cd00) 00010000:00010000:1.0:1787787245.870747:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787245.870751:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870757:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a8ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870770:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870776:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870781:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870786:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787245.870804:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870810:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870817:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff986fc29b7c00) 00010000:00010000:1.0:1787787245.870820:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787245.870823:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870838:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870879:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a8ff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80f5 expref: 8 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870891:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30a900c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80f5 expref: 7 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.870898:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff986fc29b7800) 00010000:00010000:1.0:1787787245.870900:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787245.870902:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4000, rc 0) 00000100:00100000:1.0:1787787245.870969:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:11064:x1874630484720896:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 607us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.870983:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:0.0:1787787245.878487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787245.878664:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721024 00000100:00100000:1.0:1787787245.878674:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721024 00000100:00100000:1.0:1787787245.878785:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:1.0:1787787245.878796:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:11064:x1874630484721024:12345-192.168.204.31@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787787245.878889:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:11064:x1874630484721024:12345-192.168.204.31@tcp:900:lhsmtool_posix.0 Request processed in 95us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787245.878897:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:3.0:1787787245.882241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787245.882324:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721280 00000100:00100000:1.0:1787787245.882335:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721280 00000100:00100000:1.0:1787787245.882451:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:1.0:1787787245.882462:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:11064:x1874630484721280:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787245.882499:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787245.882531:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9013 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c80fc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882616:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882631:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882644:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882660:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882667:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882674:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882780:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454f400/0x11620bc3f30a9028 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882789:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454f400/0x11620bc3f30a9028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882796:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454f400/0x11620bc3f30a9028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787245.882805:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787787245.882897:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882904:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882911:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882917:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787245.882921:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882929:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882941:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff986fc29b7800) 00010000:00010000:1.0:1787787245.882944:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787245.882949:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.882955:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a901a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883188:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883196:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883202:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883333:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787245.883337:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883344:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883353:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff986fc29b7c00) 00010000:00010000:1.0:1787787245.883356:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787245.883359:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883365:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9021 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883688:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9013 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80fc expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883704:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454f400/0x11620bc3f30a9028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80fc expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787245.883711:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:1.0:1787787245.883714:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787245.883716:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454f400, rc 0) 00000100:00100000:1.0:1787787245.883786:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11064:x1874630484721280:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 1326us (1557us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787787245.883794:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787245.898926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787245.899069:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721408 00000100:00100000:3.0:1787787245.899079:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721408 00000100:00100000:3.0:1787787245.899177:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:3.0:1787787245.899188:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11064:x1874630484721408:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787787245.899311:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11064:x1874630484721408:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 125us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787245.899319:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:0.0:1787787245.902959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787245.903102:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721536 00000100:00100000:2.0:1787787245.903111:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721536 00000100:00100000:2.0:1787787245.903229:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1787787245.903241:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed920b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:11064:x1874630484721536:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787787245.903484:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787787245.904839:0:13825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1525us 00000100:00100000:0.0:1787787245.939794:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed920b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:11064:x1874630484721536:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 36546us (36835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787245.939813:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00010000:00010000:3.0:1787787246.381442:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787246.889850:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787787246.890541:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787247.281714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787247.281761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787247.281820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787247.281859:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721920 00000100:00100000:0.0:1787787247.281867:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787247.281871:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721920 00000100:00100000:0.0:1787787247.281901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787247.281949:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484722176 00000100:00100000:3.0:1787787247.281954:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484722176 00000100:00100000:1.0:1787787247.282939:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721664 00000100:00100000:1.0:1787787247.282950:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721664 00000100:00100000:1.0:1787787247.283006:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 377 00000100:00100000:1.0:1787787247.283017:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484721664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787247.283095:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484721664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787247.283102:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 377 00000100:00100000:0.0:1787787247.285279:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484721792 00000100:00100000:0.0:1787787247.285292:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484721792 00000100:00100000:0.0:1787787247.285362:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484722048 00000100:00100000:0.0:1787787247.285366:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484722048 00000100:00100000:0.0:1787787247.285393:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 275 00000100:00100000:0.0:1787787247.285404:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484721920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787247.285476:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484721920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.285484:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 275 00000100:00100000:0.0:1787787247.285501:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 276 00000100:00100000:0.0:1787787247.285508:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484722176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787247.285532:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484722176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.285538:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 276 00000100:00100000:0.0:1787787247.285551:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 277 00000100:00100000:0.0:1787787247.285557:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484721792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787247.285710:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 278 00000100:00100000:2.0:1787787247.285721:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484722048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787247.285749:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484722048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787247.285755:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 278 00000100:00100000:0.0:1787787247.285817:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484721792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 259us (3950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.285824:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 277 00000100:00080000:2.0:1787787247.286356:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787247.286362:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787787247.402315:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787247.977909:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787247.977935:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503688064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787247.978011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787247.978077:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503688064 00000100:00100000:3.0:1787787247.978084:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503688064 00000100:00100000:3.0:1787787247.978157:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787787247.978168:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503688064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787247.978199:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787247.978245:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503688064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.978252:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787787247.978275:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787247.978305:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa3d680 x1874630503688064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787247.978332:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503688064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787247.979281:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787247.979296:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503688192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787247.979344:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787247.979594:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503688192 00000100:00100000:3.0:1787787247.979600:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503688192 00000100:00100000:3.0:1787787247.979659:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787787247.979676:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503688192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787247.979693:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787247.979731:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503688192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.979738:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787787247.979840:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787247.979865:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa3d680 x1874630503688192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787247.979880:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503688192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787248.013828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787248.022794:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484722304 00000100:00100000:0.0:1787787248.022814:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484722304 00000100:00100000:0.0:1787787248.022888:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:0.0:1787787248.022899:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11108:x1874630484722304:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787248.022918:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787248.022941:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023030:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023044:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023058:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023073:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023080:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023087:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023132:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023157:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023164:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023169:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787248.023174:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023193:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023207:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1cd00) 00010000:00010000:0.0:1787787248.023210:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787248.023215:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023221:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a903d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023237:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023243:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023248:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023254:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787248.023257:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023263:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023270:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9870d974bf00) 00010000:00010000:0.0:1787787248.023273:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787248.023276:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023291:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9044 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023331:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9036 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8103 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023342:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1cd00) 00010000:00010000:0.0:1787787248.023344:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787248.023347:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8103 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.023357:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a800, rc 0) 00000100:00100000:0.0:1787787248.023429:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11108:x1874630484722304:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 533us (9613us total) trans 0 rc 301/301 00000100:00100000:0.0:1787787248.023436:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:1.0:1787787248.033895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787248.034786:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484722560 00000100:00100000:0.0:1787787248.034799:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484722560 00000100:00100000:0.0:1787787248.034862:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:0.0:1787787248.034872:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11108:x1874630484722560:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1787787248.034929:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787248.034957:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a8ff0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80ee expref: 9 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.034979:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1cd00) 00010000:00010000:0.0:1787787248.034993:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787248.035059:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035079:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035089:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035103:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035111:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035117:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035639:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035649:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035657:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787248.035753:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2be8432 reply state 00000000b9f0cb72 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035766:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035772:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787248.035782:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787248.035786:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787787248.035791:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787787248.035798:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035804:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035810:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035816:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787248.035820:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035827:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035835:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787248.035837:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787248.035840:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035846:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a904b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787248.035861:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2be8432 reply state 00000000b9f0cb72 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035870:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.035887:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9870d974be00) 00010000:00010000:0.0:1787787248.035890:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787248.035892:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787787248.035997:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:11108:x1874630484722560:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1124us (2113us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787787248.036005:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:0.0:1787787248.175458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.175512:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484722688 00000100:00100000:3.0:1787787248.175521:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484722688 00000100:00100000:3.0:1787787248.175595:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:3.0:1787787248.175606:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:11116:x1874630484722688:12345-192.168.204.31@tcp:101:lctl.0 00010000:00010000:3.0:1787787248.175638:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787248.175662:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c810a expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.175729:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9067 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.175744:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.175755:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787248.175801:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787248.175819:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787248.175862:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.175889:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c810a expref: 12 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.175909:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c810a expref: 11 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.175918:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:3.0:1787787248.175921:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787248.175925:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031e00, rc 0) 00000100:00100000:3.0:1787787248.175991:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:11116:x1874630484722688:12345-192.168.204.31@tcp:101:lctl.0 Request processed in 387us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.175998:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:0.0:1787787248.249370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787248.249485:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484722816 00000100:00100000:1.0:1787787248.249495:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484722816 00000100:00100000:1.0:1787787248.249568:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:1.0:1787787248.249578:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:11122:x1874630484722816:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787248.249599:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787248.249682:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a906e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8111 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.249882:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.249910:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.249922:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.249935:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.249943:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.249949:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250034:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ee00/0x11620bc3f30a9083 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250044:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ee00/0x11620bc3f30a9083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250051:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ee00/0x11620bc3f30a9083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787248.250087:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787787248.250091:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787248.250131:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ee00/0x11620bc3f30a9083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250181:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250198:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250205:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250212:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787248.250216:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250224:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250238:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:1.0:1787787248.250241:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787248.250246:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250253:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250267:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250273:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250279:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250284:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787248.250293:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250300:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250308:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9870d974be00) 00010000:00010000:1.0:1787787248.250311:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787248.250314:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250320:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a907c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250350:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a906e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8111 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250362:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ee00/0x11620bc3f30a9083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8111 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.250370:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:1.0:1787787248.250372:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787787248.250375:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454ee00, rc 0) 00000100:00100000:1.0:1787787248.250442:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:11122:x1874630484722816:12345-192.168.204.31@tcp:101:bash.0 Request processed in 865us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.250451:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:0.0:1787787248.264446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.264754:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484723072 00000100:00100000:2.0:1787787248.264765:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484723072 00000100:00100000:2.0:1787787248.264938:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:2.0:1787787248.264949:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:11122:x1874630484723072:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787248.264970:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787248.264991:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a908a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8118 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.265100:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.265117:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.265128:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.265171:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.265197:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.265205:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787248.265580:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787787248.266005:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266016:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266024:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266059:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266066:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266072:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266077:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787248.266081:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266088:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266210:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787248.266213:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787248.266218:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266225:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9091 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787248.266251:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb7eb54b reply state 0000000097b27e0e transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266262:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266280:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:2.0:1787787248.266283:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787248.266286:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787787248.266336:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a908a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266353:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.266361:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:2.0:1787787248.266364:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787248.266366:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787248.266482:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:11122:x1874630484723072:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1534us (2072us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787787248.266490:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:2.0:1787787248.293830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.294037:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484723200 00000100:00100000:3.0:1787787248.294048:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484723200 00000100:00100000:3.0:1787787248.294100:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:3.0:1787787248.294108:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1874630484723200:12345-192.168.204.31@tcp:8:bash.0 00010000:00080000:3.0:1787787248.294182:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:3.0:1787787248.294215:0:8441:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a90ad 00002000:00100000:3.0:1787787248.294227:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99b164f2-528a-4a42-8406-031dcbc8cfdb/ffff986fc3a44000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787787248.294238:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787787248.294317:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787787248.294346:0:8441:0:(import.c:65:import_set_state_nolock()) ffff986fc3a40000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787248.294411:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484723200:12345-192.168.204.31@tcp:8:bash.0 Request processed in 301us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.294434:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:2.0:1787787248.306941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.307019:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484723328 00000100:00100000:3.0:1787787248.307028:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484723328 00000100:00100000:3.0:1787787248.307188:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:3.0:1787787248.307198:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:0:x1874630484723328:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787248.307216:0:9030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787248.307240:0:9030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c811f expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787248.307265:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787248.307283:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1787787248.307287:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787248.307296:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 7 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.307315:0:9030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 7 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.307327:0:9030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:3.0:1787787248.307380:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:0:x1874630484723328:12345-192.168.204.31@tcp:101:bash.0 Request processed in 184us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.307387:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00080000:1.0:1787787248.313980:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787248.317439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.317543:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484723456 00000100:00100000:3.0:1787787248.317552:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484723456 00000100:00100000:3.0:1787787248.317749:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:3.0:1787787248.317761:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:11122:x1874630484723456:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787248.317794:0:13816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787248.317811:0:13816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8126 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.317842:0:13816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.317851:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787248.317855:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787248.317860:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.317896:0:13816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.317911:0:13816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787248.317925:0:13816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13816:1874630503688320:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787248.318116:0:13816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787248.332108:0:13816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13816:1874630503688320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787248.332184:0:13816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.332207:0:13816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:3.0:1787787248.332291:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:11122:x1874630484723456:12345-192.168.204.31@tcp:101:bash.0 Request processed in 14533us (14862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.332301:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:0.0:1787787248.332552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787248.335963:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484723584 00000100:00100000:1.0:1787787248.335977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484723584 00010000:00010000:1.0:1787787248.336029:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787248.336096:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1787787248.336106:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484723584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787248.336132:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787248.336465:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.336481:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.336507:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a90b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c811f expref: 8 pid: 9030 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.336525:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787248.336530:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787248.336539:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.336549:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.336597:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787248.336614:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffad6940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6512:1874630503688448:192.168.204.31@tcp:105: 00000100:00100000:1.0:1787787248.336719:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d2379240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787248.345316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.346209:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484723840 00000100:00100000:2.0:1787787248.346220:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484723840 00000100:00100000:2.0:1787787248.346287:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:2.0:1787787248.346298:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:11122:x1874630484723840:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:1.0:1787787248.346545:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffad6940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6512:1874630503688448:192.168.204.31@tcp:105: 00010000:00010000:1.0:1787787248.346580:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787248.346650:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484723584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10545us (14098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.346660:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:2.0:1787787248.347485:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11122:x1874630484723840:12345-192.168.204.31@tcp:35:bash.0 Request processed in 1186us (2178us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787787248.347494:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00010000:00010000:1.0:1787787248.425432:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787248.460370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.460592:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484724096 00000100:00100000:3.0:1787787248.460603:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484724096 00000100:00100000:3.0:1787787248.460682:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:3.0:1787787248.460693:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11132:x1874630484724096:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787248.460717:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787248.460738:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a90c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c812d expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787248.460854:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787787248.462761:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a90c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c812d expref: 18 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.462783:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:3.0:1787787248.462787:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787248.462794:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a90c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c812d expref: 18 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.462812:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031c00, rc 0) 00000100:00100000:3.0:1787787248.463074:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:11132:x1874630484724096:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2381us (2713us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787787248.463083:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:0.0:1787787248.474742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.474833:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484724352 00000100:00100000:3.0:1787787248.474844:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484724352 00000100:00100000:3.0:1787787248.474905:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:3.0:1787787248.474916:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:11132:x1874630484724352:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787248.475209:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11132:x1874630484724352:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 294us (476us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787787248.475217:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787248.563896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787248.564392:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484724480 00000100:00100000:1.0:1787787248.564402:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484724480 00000100:00100000:1.0:1787787248.564473:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:1.0:1787787248.564484:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11138:x1874630484724480:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787248.564507:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787248.564531:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a90d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8134 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.564617:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a90d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.564632:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a90d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.564644:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a90d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787248.564845:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787787248.564850:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787248.564874:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a90d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.564919:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a90d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8134 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.565012:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a90d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8134 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.565021:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:1.0:1787787248.565024:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787248.565027:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e600, rc 0) 00000100:00100000:1.0:1787787248.565126:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11138:x1874630484724480:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 644us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.565134:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:0.0:1787787248.577540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787248.582813:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484724736 00000100:00100000:1.0:1787787248.582827:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484724736 00000100:00100000:1.0:1787787248.582906:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1787787248.582916:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11138:x1874630484724736:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787248.583640:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787248.584011:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a90de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c813b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.584133:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a90e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.584167:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a90e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.584179:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a90e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787248.584205:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787787248.584322:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a90de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c813b expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.584342:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a90e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c813b expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.584350:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:1.0:1787787248.584353:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787248.584356:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e000, rc 0) 00000100:00100000:1.0:1787787248.584589:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:11138:x1874630484724736:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1674us (7060us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787787248.584598:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:0.0:1787787248.597630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.598031:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484724992 00000100:00100000:2.0:1787787248.598043:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484724992 00000100:00100000:2.0:1787787248.598109:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:2.0:1787787248.598120:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:11138:x1874630484724992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787248.598174:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787248.598199:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a90f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8142 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.598303:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a90fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.598318:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a90fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.598328:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a90fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787248.598339:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787787248.599034:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a90f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8142 expref: 24 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.599069:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a90fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8142 expref: 23 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.599078:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:2.0:1787787248.599080:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787787248.599083:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787248.599241:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:11138:x1874630484724992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1122us (1621us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787787248.599249:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:0.0:1787787248.610413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.610710:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484725120 00000100:00100000:3.0:1787787248.610722:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484725120 00000100:00100000:3.0:1787787248.610799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1787787248.610809:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2394:x1874630484725120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787248.610827:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787248.610853:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a90e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c813b expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.610875:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:3.0:1787787248.610880:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787248.610989:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:2394:x1874630484725120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 181us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.610997:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1787787248.622283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787248.623397:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484725248 00000100:00100000:0.0:1787787248.623409:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484725248 00000100:00100000:0.0:1787787248.623583:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:0.0:1787787248.623594:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484725248:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1787787248.623652:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.623681:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.623708:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787248.623713:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787248.623718:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.623753:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.623769:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 7 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787248.623784:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3b2da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8444:1874630503688576:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787248.623890:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3aded80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787248.628100:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3b2da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8444:1874630503688576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787248.628131:0:8444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787248.629730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787248.629828:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484725376 00000100:00100000:0.0:1787787248.629837:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484725376 00002000:00100000:0.0:1787787248.629882:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff987101f7a1c0 x1874630484725376/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:109/0 lens 504/0 e 0 to 0 dl 1787787259 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787787248.629894:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff987101f7a1c0 with x1874630484725376 ext(0->12) 00010000:00010000:0.0:1787787248.629902:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 8 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.629951:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 8 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787248.629958:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff987101f7a1c0 00000100:00100000:0.0:1787787248.629992:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:0.0:1787787248.630003:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484725376:12345-192.168.204.31@tcp:4:lfs.0 00000001:00100000:2.0:1787787248.636722:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000100:00100000:0.0:1787787248.644062:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484725376:12345-192.168.204.31@tcp:4:lfs.0 Request processed in 14049us (14327us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787787248.644078:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00002000:00100000:0.0:1787787248.644091:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff987101f7a1c0 x1874630484725376/t4294967300(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:109/0 lens 504/448 e 0 to 0 dl 1787787259 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787787248.644102:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff987101f7a1c0 with x1874630484725376 ext(0->12) 00010000:00010000:0.0:1787787248.644112:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 9 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.644135:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 9 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787248.644171:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff987101f7a1c0 00000100:00100000:2.0:1787787248.649367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787248.649455:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484725504 00000100:00100000:1.0:1787787248.649466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484725504 00010000:00010000:1.0:1787787248.649509:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 9 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787248.649568:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:1.0:1787787248.649578:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484725504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787248.649595:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787787248.649611:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787787248.649615:0:6512:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787787248 00002000:00010000:1.0:1787787248.649617:0:6512:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787787248 00002000:00010000:1.0:1787787248.649620:0:6512:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787787248 00002000:00010000:1.0:1787787248.649622:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787787248.649641:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 9 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.649657:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 9 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.649681:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30a90bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8126 expref: 9 pid: 13816 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.649699:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787248.649703:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787248.649709:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.649719:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.649757:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787248.649810:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484725504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 233us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.649817:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00010000:00010000:0.0:1787787248.650288:0:8444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650301:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650330:0:8444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650338:0:8444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650345:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650352:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8be00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787248.650356:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650365:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650381:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.650389:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000470f95ac/0x11620bc3f30a9108 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787248.650454:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484725248:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 26860us (28182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787248.650463:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:2.0:1787787248.666629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.666784:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484725760 00000100:00100000:3.0:1787787248.666798:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484725760 00000100:00100000:3.0:1787787248.666865:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:3.0:1787787248.666875:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11138:x1874630484725760:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:3.0:1787787248.666949:0:6530:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a90fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8142 expref: 22 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787248.667249:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1787787248.667298:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787787248.667634:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1787787248.667684:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.667699:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 26 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.667707:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.667744:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 26 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.667760:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 26 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787248.667774:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6530:1874630503688704:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787248.667874:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1790600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787248.676732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787248.676833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484725888 00000100:00100000:0.0:1787787248.676854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484725888 00010000:00010000:0.0:1787787248.676897:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 27 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787248.676943:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:0.0:1787787248.676953:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:2391:x1874630484725888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787248.676967:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787248.676973:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 27 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.676987:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 27 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.677011:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:0.0:1787787248.677016:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.677024:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a909f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8118 expref: 27 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.677025:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.677033:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787248.677041:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6530:1874630503688704:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787248.677049:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787248.677061:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.677069:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.677074:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787248.677100:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+26:2391:x1874630484725888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 150us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787248.677107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000001:00080000:3.0:1787787248.677232:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1787787248.677354:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787787248.677445:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874630503688832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787787248.677493:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787248.677526:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e19e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787248.677537:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503688832 00000100:00100000:0.0:1787787248.677559:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503688832 00000100:00100000:0.0:1787787248.677601:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787787248.677609:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6530:x1874630503688832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787787248.677689:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6530:x1874630503688832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787248.677696:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787787248.677773:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874630503688832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787787248.677951:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1787787248.677991:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffad6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874630503688960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787787248.678020:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787248.678043:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bdb000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787248.678266:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503688960 00000100:00100000:0.0:1787787248.678271:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503688960 00000100:00100000:0.0:1787787248.678290:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787787248.678295:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6530:x1874630503688960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787787248.678397:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6530:x1874630503688960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (376us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787787248.678404:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787787248.678477:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffad6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6530:1874630503688960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787787248.678525:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1787787248.678567:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.678580:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.678591:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.678600:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787248.678604:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.678616:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.678629:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:1.0:1787787248.678632:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787787248.678637:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787248.678644:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a910f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787248.678973:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787787248.679931:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787787248.679947:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392861807741ns, next at 393861805230ns, rc = 0 00000001:00080000:1.0:1787787248.679956:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1787787248.679992:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc3a1cb00) 00010000:00010000:1.0:1787787248.679997:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787787248.680017:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a90fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8142 expref: 30 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787248.680966:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:11138:x1874630484725760:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 14087us (14342us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787787248.680978:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000020:00080000:1.0:1787787248.680984:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787787248.695172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787248.695252:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484726016 00000100:00100000:0.0:1787787248.695263:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484726016 00000100:00100000:0.0:1787787248.695382:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:0.0:1787787248.695393:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:11138:x1874630484726016:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787248.695431:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787248.695458:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9116 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8149 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.695519:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9116 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8149 expref: 30 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.695534:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9116 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8149 expref: 30 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787248.695588:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787248.695592:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787248.695596:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8aa00, rc 0) 00000100:00100000:0.0:1787787248.695709:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11138:x1874630484726016:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 317us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787248.695717:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:0.0:1787787248.703113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.703309:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484726272 00000100:00100000:2.0:1787787248.703320:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484726272 00000100:00100000:2.0:1787787248.703373:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:2.0:1787787248.703384:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0d4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11138:x1874630484726272:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1787787248.705517:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0d4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+31:11138:x1874630484726272:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 2123us (2402us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787787248.705532:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:3.0:1787787248.834192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.834283:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484726528 00000100:00100000:2.0:1787787248.834292:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484726528 00000100:00100000:2.0:1787787248.834368:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:2.0:1787787248.834377:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+31:11148:x1874630484726528:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787248.834403:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787248.834423:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a911d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8150 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787248.834532:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787787248.834662:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a911d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8150 expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.834675:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:2.0:1787787248.834678:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787248.834683:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a911d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8150 expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.834696:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787248.834752:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11148:x1874630484726528:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 376us (570us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787787248.834759:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:0.0:1787787248.839282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.839385:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484726656 00000100:00100000:3.0:1787787248.839396:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484726656 00000100:00100000:3.0:1787787248.839456:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:3.0:1787787248.839480:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11148:x1874630484726656:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1787787248.839577:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839605:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839621:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839633:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839641:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839648:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839726:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839750:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839757:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787248.839806:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839820:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839827:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839834:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839841:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787248.839844:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839852:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839863:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787248.839867:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787248.839872:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839878:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a912b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839903:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839910:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839917:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839923:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787248.839926:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839932:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839940:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:3.0:1787787248.839942:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787248.839945:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839951:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9132 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839961:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839966:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839972:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839982:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787248.839986:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.839992:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.840001:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787248.840003:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787248.840006:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.840012:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9139 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787248.840097:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11148:x1874630484726656:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 617us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.840106:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:0.0:1787787248.844024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787248.844128:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484726912 00000100:00100000:1.0:1787787248.844176:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484726912 00000100:00100000:1.0:1787787248.844245:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:1.0:1787787248.844255:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11148:x1874630484726912:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1787787248.844670:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+33:11148:x1874630484726912:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 415us (653us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787787248.844678:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787248.922785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.922879:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484727168 00000100:00100000:2.0:1787787248.922889:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484727168 00000100:00100000:2.0:1787787248.922953:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:2.0:1787787248.922962:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+33:11151:x1874630484727168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787248.922985:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787248.923005:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9140 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8157 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923100:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923115:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923126:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923178:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923186:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923194:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923297:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923306:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923312:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787248.923321:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787787248.923387:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923393:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923406:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923412:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787248.923416:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923423:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923435:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787248.923438:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787248.923442:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923449:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9147 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923461:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923466:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923472:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923477:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787248.923480:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923494:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923501:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:2.0:1787787248.923503:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787248.923506:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923511:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a914e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923543:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9140 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 36 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923567:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 35 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.923573:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787248.923575:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787248.923578:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2400, rc 0) 00000100:00100000:2.0:1787787248.923642:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11151:x1874630484727168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 681us (868us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787787248.923649:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:0.0:1787787248.932070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787248.932292:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484727296 00000100:00100000:2.0:1787787248.932304:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484727296 00000100:00100000:2.0:1787787248.932480:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1787787248.932493:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11151:x1874630484727296:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:2.0:1787787248.932595:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932621:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932633:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932674:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932681:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932689:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932694:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787248.932697:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932705:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932715:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787248.932718:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787248.932733:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787248.932740:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9163 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787248.932829:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11151:x1874630484727296:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 339us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787248.932838:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:0.0:1787787248.935664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787248.935786:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484727552 00000100:00100000:3.0:1787787248.935796:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484727552 00000100:00100000:3.0:1787787248.935852:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:3.0:1787787248.935863:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11151:x1874630484727552:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787248.936112:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+36:11151:x1874630484727552:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 250us (459us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787787248.936120:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:0.0:1787787249.253560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787249.254002:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484727808 00000100:00100000:3.0:1787787249.254011:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484727808 00000100:00100000:3.0:1787787249.254184:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1787787249.254220:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+36:11182:x1874630484727808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1787787249.254246:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787249.254267:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a916a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c815e expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.254369:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9171 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.254384:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.254395:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787249.254406:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787787249.254558:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a916a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c815e expref: 39 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.254577:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c815e expref: 38 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.254585:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787249.255041:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787249.255047:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:3.0:1787787249.255112:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11182:x1874630484727808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 904us (1572us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787787249.255120:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1787787249.259481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787249.259588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484728192 00000100:00100000:0.0:1787787249.259608:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484728192 00000100:00100000:0.0:1787787249.259685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:0.0:1787787249.259695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:2394:x1874630484728192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787249.259710:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787249.259735:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9171 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c815e expref: 38 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.259762:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787249.259767:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787787249.259779:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787249.259819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:2394:x1874630484728192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787249.259835:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:0.0:1787787249.262087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787249.262176:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484728064 00000100:00100000:3.0:1787787249.262192:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484728064 00000100:00100000:3.0:1787787249.262251:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:3.0:1787787249.262261:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:11182:x1874630484728064:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1787787249.262505:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11182:x1874630484728064:12345-192.168.204.31@tcp:35:cat.0 Request processed in 244us (427us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787787249.262513:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:0.0:1787787249.344019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787249.344112:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484728448 00000100:00100000:2.0:1787787249.344121:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484728448 00000100:00100000:2.0:1787787249.344216:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787249.344226:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11188:x1874630484728448:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1787787249.344252:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787249.344256:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787787249.344282:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a90d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8134 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.344303:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787249.344308:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787249.344321:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a917f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8165 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.344429:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.344457:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.344467:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.344501:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.344530:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 38 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787249.344557:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503689088:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787249.344681:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787249.348090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787249.348188:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484728576 00000100:00100000:3.0:1787787249.348205:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484728576 00010000:00010000:3.0:1787787249.348246:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 39 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787249.348289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:3.0:1787787249.348300:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:2392:x1874630484728576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787249.348315:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787249.348321:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 39 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.348335:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 39 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.348357:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787249.348362:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.348372:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.348379:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.348413:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787249.348482:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:2392:x1874630484728576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787249.348489:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00010000:00010000:2.0:1787787249.348816:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9155 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8157 expref: 38 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787249.348843:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503689088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787249.348865:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.348874:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.348879:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787249.348896:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787787249.349044:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a917f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 39 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.349062:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.349070:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787249.349080:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787249.349083:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787249.349109:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11188:x1874630484728448:12345-192.168.204.31@tcp:101:dd.0 Request processed in 4885us (5101us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787787249.349117:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1787787249.352525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787249.352630:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484728704 00000100:00100000:3.0:1787787249.352640:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484728704 00000100:00100000:3.0:1787787249.352815:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:3.0:1787787249.352921:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11188:x1874630484728704:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1787787249.352947:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787249.352966:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9194 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c816c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.352999:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.353013:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.353024:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.353906:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9194 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 40 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.353930:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 39 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787249.353939:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787249.353951:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787787249.353955:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:3.0:1787787249.354020:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:11188:x1874630484728704:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1196us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787249.354027:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:1.0:1787787249.360208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787249.360288:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484728960 00000100:00100000:2.0:1787787249.360297:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484728960 00000100:00100000:2.0:1787787249.360357:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:2.0:1787787249.360369:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:11188:x1874630484728960:12345-192.168.204.31@tcp:36:dd.0 00010000:00010000:2.0:1787787249.360603:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.360621:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.360632:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787249.360675:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1787787249.360699:0:13825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041e6ec72 reply state 00000000468b5340 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.360712:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.360721:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787249.360723:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787249.360727:0:13825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787249.360819:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+42:11188:x1874630484728960:12345-192.168.204.31@tcp:36:dd.0 Request processed in 452us (629us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787787249.360962:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00000020:00080000:2.0:1787787249.360967:0:13825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787787249.449472:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787249.660085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787249.660299:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484729088 00000100:00100000:0.0:1787787249.660309:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484729088 00000100:00100000:0.0:1787787249.660375:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:0.0:1787787249.660391:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+42:11202:x1874630484729088:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:0.0:1787787249.660415:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787249.660574:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a91a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8173 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660651:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660665:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660676:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660686:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660692:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660698:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660772:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660796:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 43 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660804:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660836:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 43 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.660851:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 43 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787249.660865:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503689216:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787249.661011:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3adea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787249.664252:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787249.664754:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484729344 00000100:00100000:3.0:1787787249.664765:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484729344 00000100:00100000:3.0:1787787249.664839:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:3.0:1787787249.664849:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:6161:x1874630484729344:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787787249.665076:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503689216:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787249.665104:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787249.665204:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+45:6161:x1874630484729344:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 355us (959us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787787249.665738:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1787787249.668109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787249.668435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484729472 00000100:00100000:0.0:1787787249.668445:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484729472 00010000:00010000:0.0:1787787249.668487:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 45 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787249.668666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:0.0:1787787249.668677:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+45:2392:x1874630484729472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787249.668692:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787249.668712:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 45 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.668725:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 45 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.668749:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9186 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8165 expref: 45 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.668768:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787249.668774:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.668785:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.668793:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.668829:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787249.668855:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.668863:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787249.668897:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:2392:x1874630484729472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 221us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787249.668905:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000004:00200000:1.0:1787787249.668917:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787787249.668921:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787249.668971:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.668985:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.668995:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669001:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669008:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669015:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787249.669018:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669026:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669035:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:1.0:1787787249.669037:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787249.669041:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669046:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a91b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669056:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669062:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669075:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669080:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787249.669082:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669088:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669096:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:1.0:1787787249.669099:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787249.669102:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669107:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a91b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669187:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a91a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8173 expref: 44 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669202:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8173 expref: 43 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787249.669210:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:1.0:1787787249.669222:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787249.669225:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b800, rc 0) 00000100:00100000:1.0:1787787249.669253:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:11202:x1874630484729088:12345-192.168.204.31@tcp:101:stat.0 Request processed in 8870us (9180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787249.669269:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:1.0:1787787249.744310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787249.744422:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484729728 00000100:00100000:2.0:1787787249.744434:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484729728 00000100:00100000:2.0:1787787249.744541:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:2.0:1787787249.744552:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:11208:x1874630484729728:12345-192.168.204.31@tcp:36:truncate.0 00010000:00010000:2.0:1787787249.744624:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787249.744661:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8173 expref: 43 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.744682:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787249.744687:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787249.744873:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.744889:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.744898:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787249.744939:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1787787249.744961:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ccb00aa reply state 000000003d52996e transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.744971:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787249.744977:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787249.744992:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787249.744995:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787249.745199:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+45:11208:x1874630484729728:12345-192.168.204.31@tcp:36:truncate.0 Request processed in 647us (899us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787787249.745207:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000020:00080000:2.0:1787787249.745212:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787787249.958009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787249.959519:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484729856 00000100:00100000:0.0:1787787249.959542:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484729856 00000100:00100000:0.0:1787787249.959616:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:0.0:1787787249.959627:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+45:11222:x1874630484729856:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:0.0:1787787249.959652:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787249.959675:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a91cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c817a expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959764:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959781:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959795:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959806:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959813:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959820:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959896:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959905:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.959912:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787249.959959:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787787249.959964:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787249.959988:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960012:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960021:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960027:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960033:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960039:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787249.960044:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960052:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960065:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787249.960069:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787249.960074:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960080:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a91d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960095:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960100:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960112:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960117:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8be00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787249.960120:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960126:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960133:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:0.0:1787787249.960190:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787249.960195:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960201:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a91da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960229:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a91cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 47 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960244:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 46 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787249.960252:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787249.960254:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787249.960257:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b800, rc 0) 00000100:00100000:0.0:1787787249.960326:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+46:11222:x1874630484729856:12345-192.168.204.31@tcp:101:stat.0 Request processed in 700us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787249.960343:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:3.0:1787787250.025994:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503689344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787250.026072:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.026896:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503689344 00000100:00100000:0.0:1787787250.026907:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503689344 00000100:00100000:0.0:1787787250.026969:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787787250.026979:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503689344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787250.027041:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787250.027124:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503689344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.027133:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787787250.027320:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503689344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787250.094969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.095091:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484730112 00000100:00100000:2.0:1787787250.095103:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484730112 00000100:00100000:2.0:1787787250.095192:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:2.0:1787787250.095202:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+46:11232:x1874630484730112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787250.095222:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787250.095243:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a91e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8181 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787250.095349:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787787250.095477:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a91e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8181 expref: 48 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.095493:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:2.0:1787787250.095496:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787250.095502:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a91e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8181 expref: 48 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.095520:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2600, rc 0) 00000100:00100000:2.0:1787787250.095827:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:11232:x1874630484730112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 624us (867us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1787787250.095854:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:1.0:1787787250.109096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.110182:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484730368 00000100:00100000:2.0:1787787250.110197:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484730368 00000100:00100000:2.0:1787787250.110324:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:2.0:1787787250.110336:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:11232:x1874630484730368:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1787787250.110615:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+48:11232:x1874630484730368:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 281us (1536us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787787250.110623:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:1.0:1787787250.213325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787250.213516:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484730624 00000100:00100000:3.0:1787787250.213536:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484730624 00000100:00100000:3.0:1787787250.213718:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:3.0:1787787250.213850:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+48:11238:x1874630484730624:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787250.213880:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787250.213904:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a91f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8188 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.214019:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.214035:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 49 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.214059:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.214092:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 49 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.214106:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 49 pid: 13825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787250.214119:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874630503689472:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787250.214454:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787250.220116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.220299:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484730752 00000100:00100000:2.0:1787787250.220310:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484730752 00010000:00010000:2.0:1787787250.220354:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 50 pid: 13825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787250.220402:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:2.0:1787787250.220412:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:2392:x1874630484730752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787250.220429:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787250.220445:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 50 pid: 13825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.220461:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 50 pid: 13825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.220485:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787250.220491:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.220530:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.220540:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.220562:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787250.220634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:2392:x1874630484730752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 214us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.220642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00010000:00010000:3.0:1787787250.222983:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a91e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c817a expref: 49 pid: 13825 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787250.223018:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874630503689472:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787250.223044:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.223055:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.223061:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787250.223087:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787787250.223415:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a91f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 50 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.223591:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 49 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.223602:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787250.223606:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787250.223609:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:3.0:1787787250.223689:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+49:11238:x1874630484730624:12345-192.168.204.31@tcp:101:bash.0 Request processed in 9960us (10373us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787787250.223698:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:1.0:1787787250.226901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.227048:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484731008 00000100:00100000:0.0:1787787250.227058:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484731008 00000100:00100000:0.0:1787787250.227122:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:0.0:1787787250.227131:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+49:11238:x1874630484731008:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:0.0:1787787250.227410:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.227428:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.227439:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787250.227482:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787787250.227504:0:13825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001512b186 reply state 00000000c0f3bc6a transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.227516:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.227544:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787250.227547:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787250.227551:0:13825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787250.227654:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:11238:x1874630484731008:12345-192.168.204.31@tcp:36:bash.0 Request processed in 523us (765us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787787250.227662:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000020:00080000:0.0:1787787250.227668:0:13825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787787250.236976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.237065:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484731136 00000100:00100000:0.0:1787787250.237075:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484731136 00000100:00100000:0.0:1787787250.237427:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:0.0:1787787250.237436:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:11238:x1874630484731136:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787250.237462:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787250.237482:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9212 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c818f expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.237584:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.237600:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.237609:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.237650:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.237664:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 53 pid: 6529 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787250.237691:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ef9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503689600:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787250.237777:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3adea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787250.241274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.241376:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ef9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503689600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787250.241405:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787250.242179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484731264 00000100:00100000:3.0:1787787250.242189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484731264 00010000:00010000:3.0:1787787250.242231:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 54 pid: 6529 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787250.242272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:3.0:1787787250.242281:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:2391:x1874630484731264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787250.242297:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787250.242306:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 54 pid: 6529 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.242320:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 54 pid: 6529 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.242344:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a91fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8188 expref: 54 pid: 6529 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.242381:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787250.242386:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.242397:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.242404:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.242547:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787250.242633:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:2391:x1874630484731264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 345us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.242640:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00010000:00010000:0.0:1787787250.242640:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.242647:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787250.242701:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787787250.242706:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787250.242728:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.242761:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9212 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c818f expref: 53 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.242778:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c818f expref: 52 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.242786:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787250.242788:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787250.242791:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a000, rc 0) 00000100:00100000:0.0:1787787250.242818:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:11238:x1874630484731136:12345-192.168.204.31@tcp:101:bash.0 Request processed in 5383us (5853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.242832:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:1.0:1787787250.247324:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787250.247398:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484731520 00000100:00100000:3.0:1787787250.247409:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484731520 00000100:00100000:3.0:1787787250.247458:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787250.247467:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d0d4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:11238:x1874630484731520:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1787787250.247681:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d0d4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:11238:x1874630484731520:12345-192.168.204.31@tcp:35:bash.0 Request processed in 215us (367us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787787250.247689:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:1.0:1787787250.378549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.379104:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484731776 00000100:00100000:2.0:1787787250.379115:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484731776 00000100:00100000:2.0:1787787250.379215:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:2.0:1787787250.379226:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:11248:x1874630484731776:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787250.379252:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787250.379275:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8196 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787250.379384:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787787250.379488:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9220 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8196 expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.379503:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:2.0:1787787250.379530:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787250.379537:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8196 expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.379551:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2600, rc 0) 00000100:00100000:2.0:1787787250.379634:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11248:x1874630484731776:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 409us (1095us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787787250.379641:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:1.0:1787787250.391995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.392098:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484731904 00000100:00100000:0.0:1787787250.392110:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484731904 00000100:00100000:0.0:1787787250.392208:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:0.0:1787787250.392219:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11248:x1874630484731904:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:0.0:1787787250.392297:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392315:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392327:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392339:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392347:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392354:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392429:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392439:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392447:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787250.392511:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392537:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392544:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392551:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392557:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8be00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787250.392561:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392784:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392800:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787250.392803:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787250.392808:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392815:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a922e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392828:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392834:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392847:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392853:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8ac00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787250.392856:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392862:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392871:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:0.0:1787787250.392874:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787250.392877:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392883:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9235 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392894:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392900:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392905:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392909:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787250.392912:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392929:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392937:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787250.392939:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787250.392942:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.392948:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a923c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787250.393024:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11248:x1874630484731904:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 807us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.393032:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:1.0:1787787250.398534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787250.398598:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484732160 00000100:00100000:3.0:1787787250.398608:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484732160 00000100:00100000:3.0:1787787250.398676:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:3.0:1787787250.398686:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11248:x1874630484732160:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787250.400316:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:11248:x1874630484732160:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 1362us (1536us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787787250.400329:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:1.0:1787787250.443121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.443351:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484732416 00000100:00100000:2.0:1787787250.443360:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484732416 00000100:00100000:2.0:1787787250.443422:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:2.0:1787787250.443431:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:11251:x1874630484732416:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787250.443456:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787250.443477:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9243 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c819d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443568:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443586:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443598:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443609:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443615:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443641:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443747:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9258 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443756:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.443764:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787250.443773:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787787250.444305:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444316:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444323:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444329:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787250.444333:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444342:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444353:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787250.444357:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787250.444368:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444374:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a924a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444388:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444395:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444400:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444405:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787250.444408:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444414:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444421:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:2.0:1787787250.444424:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787250.444427:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444432:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9251 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444472:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9243 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c819d expref: 58 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444499:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9258 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c819d expref: 57 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.444506:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787250.444509:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787250.444511:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787250.444597:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:11251:x1874630484732416:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1166us (1485us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787787250.444605:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:1.0:1787787250.450987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787250.453953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787250.454304:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484732672 00000100:00100000:3.0:1787787250.454314:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484732672 00000100:00100000:3.0:1787787250.454453:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:3.0:1787787250.454467:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:11251:x1874630484732672:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:3.0:1787787250.454545:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454575:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454588:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454624:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454631:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454638:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454646:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787250.454650:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454658:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454671:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:3.0:1787787250.454674:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787250.454679:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787250.454696:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787250.454779:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:11251:x1874630484732672:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 316us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787250.454788:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:0.0:1787787250.455531:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484732544 00000100:00100000:0.0:1787787250.455540:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484732544 00000100:00100000:0.0:1787787250.455602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:0.0:1787787250.455612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:2394:x1874630484732544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787250.455627:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787250.455647:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9258 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c819d expref: 57 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.455663:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787250.455667:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787250.455715:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+56:2394:x1874630484732544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 104us (4739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.455723:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:1.0:1787787250.459905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.460569:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484732928 00000100:00100000:0.0:1787787250.460579:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484732928 00000100:00100000:0.0:1787787250.460640:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787250.460650:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+56:11251:x1874630484732928:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787250.461649:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:11251:x1874630484732928:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 995us (1748us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787787250.461660:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00010000:00010000:1.0:1787787250.473382:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787250.537451:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503689984:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.537451:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ef9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503689728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787250.537482:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503689856:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.537671:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503690112:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.537896:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.537948:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503690240:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.537974:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.537992:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503690752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787250.538015:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.538042:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffacb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503691264:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.538064:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.538094:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690752 00000100:00100000:0.0:1787787250.538101:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690752 00000100:00100000:0.0:1787787250.538179:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787787250.538188:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503690752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787250.538225:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787250.538266:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503690752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.538273:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787787250.538293:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503691264 00000100:00100000:0.0:1787787250.538296:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503691264 00000100:00100000:0.0:1787787250.538320:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787250.538334:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503691264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.538524:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503691264:12345-0@lo:400:kworker.0 Request processed in 178us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.538532:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787787250.538550:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787250.538588:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503689728 00000100:00100000:0.0:1787787250.538592:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503689728 00000100:00100000:0.0:1787787250.538637:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787787250.538644:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503689728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787250.538668:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787787250.538701:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503689728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.538707:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787787250.538760:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffacb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503691264:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.538777:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ef9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503689728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787250.538800:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503690752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787250.538829:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690240 00000100:00100000:0.0:1787787250.538832:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690240 00000100:00100000:0.0:1787787250.538859:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787787250.538864:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503690240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.538899:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503690240:12345-0@lo:400:kworker.0 Request processed in 35us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.538906:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787787250.538930:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503690240:0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.539980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787250.540030:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503690496:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.540046:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503689984 00000100:00100000:0.0:1787787250.540062:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503689984 00000100:00100000:3.0:1787787250.540086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787250.540088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.540100:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690496 00000100:00100000:0.0:1787787250.540105:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690496 00000100:00100000:1.0:1787787250.540135:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503691008:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.540157:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787787250.540168:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503689984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.540185:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787250.540374:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503690368:0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.540992:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503691520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787250.541024:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503689984:12345-0@lo:400:kworker.0 Request processed in 856us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.541033:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787787250.541045:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.541054:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503691008 00000100:00100000:0.0:1787787250.541060:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503691008 00000100:00100000:1.0:1787787250.541086:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503689984:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.541093:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787787250.541103:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503690496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.541126:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503691520 00000100:00100000:1.0:1787787250.541131:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503691520 00000100:00100000:1.0:1787787250.541183:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787787250.541191:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503691520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787250.541206:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787250.541237:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503691520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787250.541244:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787787250.541256:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503690496:12345-0@lo:400:kworker.0 Request processed in 66us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.541267:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787787250.541286:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787787250.541295:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.541302:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503691520:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787787250.541319:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffa3da40 x1874630503690496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787250.541331:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503690496:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.541335:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503691008:12345-0@lo:400:kworker.0 Request processed in 40us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.541344:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1787787250.541367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787250.541368:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503691008:0@lo:400:kworker.0 00000100:00080000:0.0:1787787250.541372:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787250.542044:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787250.542114:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503690624:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.542162:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787250.542300:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690112 00000100:00100000:0.0:1787787250.542309:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690112 00000100:00100000:0.0:1787787250.542342:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787787250.542350:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503690112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.542389:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503690112:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.542488:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffacbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503691136:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.542528:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787250.542562:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503690112:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.542586:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690624 00000100:00100000:2.0:1787787250.542589:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690624 00000100:00100000:2.0:1787787250.542622:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787787250.542629:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503690624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.542664:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503690624:12345-0@lo:400:kworker.0 Request processed in 37us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.542671:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787787250.542689:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787250.542720:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503690624:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.542736:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503691136 00000100:00100000:2.0:1787787250.542739:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503691136 00000100:00100000:2.0:1787787250.542768:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787787250.542774:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503691136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.542906:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787787250.543537:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503691136:12345-0@lo:400:kworker.0 Request processed in 761us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.543544:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:2.0:1787787250.543560:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787787250.543605:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ffacbc00 x1874630503691136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787250.543616:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffacbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503691136:0@lo:400:kworker.0 00000100:00100000:3.0:1787787250.546472:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787250.546537:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffaca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503690880:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.546738:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690368 00000100:00100000:0.0:1787787250.546746:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690368 00000100:00100000:3.0:1787787250.546871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787250.546875:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503689856 00000100:00100000:1.0:1787787250.546882:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503689856 00000100:00100000:3.0:1787787250.546899:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503690880 00000100:00100000:3.0:1787787250.546903:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503690880 00000100:00100000:1.0:1787787250.546941:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787787250.546954:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503689856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.546964:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787787250.546974:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffaca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503690368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.547027:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503689856:12345-0@lo:400:kworker.0 Request processed in 75us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.547028:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffaca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503690368:12345-0@lo:400:kworker.0 Request processed in 55us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.547044:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787787250.547046:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:2.0:1787787250.550106:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787250.550120:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787250.550184:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503691392:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.550369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787250.550552:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503689856:0@lo:400:kworker.0 00000100:00100000:2.0:1787787250.550572:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503690368:0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.550990:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503691392 00000100:00100000:0.0:1787787250.550998:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503691392 00000100:00100000:0.0:1787787250.551058:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787787250.551067:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503691392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787250.551205:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503691392:12345-0@lo:400:kworker.0 Request processed in 139us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.551230:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787787250.551384:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffac9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503691392:0@lo:400:kworker.0 00000100:00100000:3.0:1787787250.551527:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787787250.551538:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503690880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787250.551607:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503690880:12345-0@lo:400:kworker.0 Request processed in 71us (4736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787250.551614:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787250.552967:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffaca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503690880:0@lo:400:kworker.0 00000100:00100000:1.0:1787787250.645468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.645594:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484733184 00000100:00100000:0.0:1787787250.645607:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484733184 00000100:00100000:0.0:1787787250.645674:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:0.0:1787787250.645684:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:11269:x1874630484733184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1787787250.645709:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787250.645730:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a926d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81a4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.646055:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9274 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.646071:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9274 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.646083:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9274 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787250.646097:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787787250.647068:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a926d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81a4 expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.647092:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9274 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81a4 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.647100:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787250.647103:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787787250.647106:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8ac00, rc 0) 00000100:00100000:0.0:1787787250.651087:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11269:x1874630484733184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5392us (5619us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787787250.651100:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:1.0:1787787250.698529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.698659:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484733312 00000100:00100000:0.0:1787787250.698669:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484733312 00000100:00100000:0.0:1787787250.698736:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:0.0:1787787250.698746:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11270:x1874630484733312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787250.698770:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787250.698797:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81ab expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.698893:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.698908:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.698920:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787250.698966:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787787250.698970:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787250.698989:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.699016:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ab expref: 61 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.699035:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ab expref: 60 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.699043:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787250.699046:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787250.699050:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8be00, rc 0) 00000100:00100000:0.0:1787787250.699112:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11270:x1874630484733312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 368us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.699120:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:1.0:1787787250.718994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787250.719244:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484733696 00000100:00100000:3.0:1787787250.719255:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484733696 00000100:00100000:3.0:1787787250.719318:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:3.0:1787787250.719328:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11270:x1874630484733696:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787250.719825:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11270:x1874630484733696:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 489us (831us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787787250.719848:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:1.0:1787787250.725728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.726688:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484733824 00000100:00100000:2.0:1787787250.726699:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484733824 00000100:00100000:2.0:1787787250.726828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:2.0:1787787250.726840:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11270:x1874630484733824:12345-192.168.204.31@tcp:103:lfs.0 00010000:00010000:2.0:1787787250.726856:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787787250.726882:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c818f expref: 61 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.726923:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81a4 expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.726948:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9116 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8149 expref: 59 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.726959:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787250.726964:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787250.727029:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11270:x1874630484733824:12345-192.168.204.31@tcp:103:lfs.0 Request processed in 192us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.727037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:1.0:1787787250.732871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787250.732969:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484733952 00000100:00100000:0.0:1787787250.733000:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484733952 00000100:00100000:0.0:1787787250.733076:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:0.0:1787787250.733086:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c13252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11270:x1874630484733952:12345-192.168.204.31@tcp:58:lfs.0 00010000:00010000:0.0:1787787250.733239:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.733259:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787250.733272:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787250.733528:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787250.733668:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787787250.733757:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787787250.733836:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c13252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11270:x1874630484733952:12345-192.168.204.31@tcp:58:lfs.0 Request processed in 750us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.733845:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:1.0:1787787250.774685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787250.774836:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484734080 00000100:00100000:2.0:1787787250.774848:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484734080 00000100:00100000:2.0:1787787250.774913:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:2.0:1787787250.774923:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11272:x1874630484734080:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787250.774954:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787250.774975:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9297 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775044:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775061:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775072:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775101:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775109:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775116:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775222:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775231:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775238:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787250.775276:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787787250.775280:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787250.775296:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775307:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775314:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775319:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775335:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775340:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787250.775344:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775351:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775362:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787250.775364:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787250.775369:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775375:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a929e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775386:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775391:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775396:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775401:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787250.775404:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775418:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775426:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:2.0:1787787250.775429:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787250.775432:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775437:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a92a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775462:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9297 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775473:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 59 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787250.775480:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787250.775482:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787250.775484:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2e00, rc 0) 00000100:00100000:2.0:1787787250.775544:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11272:x1874630484734080:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 622us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787250.775551:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00000040:00080000:3.0:1787787250.985437:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787250.985448:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787250.985493:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787787250.985503:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787250.985670:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffac8b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503691648:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787250.985821:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e19e6a80 going to sleep for 11 seconds 00000040:00080000:0.0:1787787251.000829:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787251.001442:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffac8b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503691648:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787251.002277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.003479:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484734208 00000100:00100000:0.0:1787787251.003492:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484734208 00000100:00100000:0.0:1787787251.003665:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:0.0:1787787251.003677:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11283:x1874630484734208:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1787787251.003993:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1787787251.004465:0:13672:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787251.004613:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11283:x1874630484734208:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 937us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.004623:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 78 00000001:00080000:2.0:1787787251.011278:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1787787251.011331:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787787251.011357:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870d2379cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787787251.011363:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc10c9100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870d2379480 00000020:00080000:2.0:1787787251.011366:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc10c9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870c3286e00 00010000:00010000:1.0:1787787251.011474:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011487:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011496:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011513:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.011519:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011527:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011547:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9870d974be00) 00010000:00010000:1.0:1787787251.011550:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787251.011565:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011572:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9052 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011593:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011598:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011620:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011626:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.011628:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011635:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011643:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:1.0:1787787251.011645:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787251.011648:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011654:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9059 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011669:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011675:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011681:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011685:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.011688:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011703:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011712:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1c700) 00010000:00010000:1.0:1787787251.011714:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787251.011718:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011723:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9098 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011741:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011747:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011752:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011758:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.011761:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011767:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.011904:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1787787251.011905:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:1.0:1787787251.011907:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787251.011911:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011926:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a91a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.011928:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffac8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503691776:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787787251.011937:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011943:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011948:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011953:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.011955:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011961:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011968:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:1.0:1787787251.011970:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787251.011972:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011977:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a91c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011985:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.011991:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.012002:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787251.012002:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012007:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.012010:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012016:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012023:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:1.0:1787787251.012025:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787251.012027:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012032:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a920b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.012058:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503691776 00000100:00100000:3.0:1787787251.012067:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503691776 00000020:00080000:1.0:1787787251.012069:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1787787251.012117:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787251.012126:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503691776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787787251.012196:0:9030:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1787787251.012229:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f77f0, atime: 0x6a8f77f0, ctime: 0x6a8f77f0, blocks: 0x8 00010000:00010000:3.0:1787787251.012236:0:9030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.012249:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1787787251.012253:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787251.012260:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787787251.012263:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1787787251.012274:0:9030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.012289:0:9030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.012296:0:9030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.012317:0:9030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787251.012348:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787251.012354:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012361:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787251.012365:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012373:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012391:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012398:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063eefdee/0x11620bc3f30a92b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.012413:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787251.012415:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787251.012417:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787251.012438:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503691776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 312us (435us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787787251.012445:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1787787251.012470:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9870ffac8f00/2, rc 0, transno 4294967302 00000100:00100000:2.0:1787787251.012476:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffac8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503691776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787787251.021872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.021960:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484734336 00000100:00100000:2.0:1787787251.021970:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484734336 00000100:00100000:2.0:1787787251.022027:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:2.0:1787787251.022037:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:11283:x1874630484734336:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787787251.022107:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022124:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022155:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022340:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022349:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022356:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022384:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022404:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022411:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787251.022455:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787787251.022459:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787251.022478:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022488:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022494:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022501:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022519:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787251.022523:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022531:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022543:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:2.0:1787787251.022546:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787251.022549:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022566:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a92ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022578:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022584:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022589:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022594:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787251.022597:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022603:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022612:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff986fc3a1c900) 00010000:00010000:2.0:1787787251.022614:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787251.022617:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022623:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022637:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022643:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022655:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022660:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787251.022663:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022669:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022678:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787251.022680:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787251.022683:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.022688:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.024634:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:11283:x1874630484734336:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 Request processed in 2587us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787251.024648:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:1.0:1787787251.043709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.043833:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484734592 00000100:00100000:2.0:1787787251.043842:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484734592 00000100:00100000:2.0:1787787251.043904:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:2.0:1787787251.043914:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:11283:x1874630484734592:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787251.043934:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787251.043954:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.044064:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.044078:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.044104:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787251.044116:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787787251.044424:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044432:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044438:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044443:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.044447:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044453:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044476:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:1.0:1787787251.044478:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787251.044482:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044488:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a92d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044539:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b9 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044549:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:1.0:1787787251.044551:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787251.044554:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a92cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b9 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.044565:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2000, rc 0) 00000100:00100000:1.0:1787787251.044629:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11283:x1874630484734592:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 717us (931us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1787787251.044637:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:3.0:1787787251.056513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.056679:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484734720 00000100:00100000:0.0:1787787251.056690:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484734720 00000100:00100000:0.0:1787787251.056772:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:0.0:1787787251.056782:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11283:x1874630484734720:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787787251.056819:0:13672:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787251.056991:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11283:x1874630484734720:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 209us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.057000:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:1.0:1787787251.085540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.086403:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484734976 00000100:00100000:3.0:1787787251.086416:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484734976 00000100:00100000:3.0:1787787251.086478:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:3.0:1787787251.086489:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11283:x1874630484734976:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787251.086519:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787251.086522:0:13825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787787251.086551:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ab expref: 13 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.086572:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787251.086577:0:13825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787251.086592:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a92e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81c0 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787787251.087008:0:13825:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787787251.087576:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a92eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.087591:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a92eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.087611:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a92eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.087670:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a92e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c0 expref: 15 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.087689:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a92eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c0 expref: 14 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.087698:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc2a19500) 00010000:00010000:3.0:1787787251.087701:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787251.087704:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:3.0:1787787251.087779:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484734976:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 1291us (2249us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787787251.087787:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:1.0:1787787251.095078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.095756:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484735232 00000100:00100000:0.0:1787787251.095768:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484735232 00000100:00100000:0.0:1787787251.095882:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:0.0:1787787251.095892:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484735232:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787251.095952:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787251.095979:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a92eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c0 expref: 14 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096001:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc2a19500) 00010000:00010000:0.0:1787787251.096011:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787251.096036:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096051:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096061:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096076:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096084:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096108:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096200:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096209:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096216:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096222:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787251.096227:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096233:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096242:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787251.096245:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787251.096248:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096254:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a92f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096264:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096270:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096283:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096288:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787251.096291:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096297:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096305:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9c7826db (ffff9870d4cec400) 00010000:00010000:0.0:1787787251.096307:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787251.096311:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.096316:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9300 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9c7826db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.096404:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11283:x1874630484735232:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 513us (1337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787251.096411:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:1.0:1787787251.099874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.099954:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484735360 00000100:00100000:2.0:1787787251.099964:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484735360 00000100:00100000:2.0:1787787251.100172:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:2.0:1787787251.100184:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11283:x1874630484735360:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787251.100215:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787251.100239:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9307 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81c7 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.100274:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.100288:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.100299:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.100405:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9307 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 15 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.100423:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 14 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.100432:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:2.0:1787787251.100440:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787251.100444:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2200, rc 0) 00000100:00100000:2.0:1787787251.100513:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484735360:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 321us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787251.100522:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:2.0:1787787251.103018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787251.103122:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484735616 00000100:00100000:1.0:1787787251.103591:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484735616 00000100:00100000:1.0:1787787251.103688:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:1.0:1787787251.103699:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484735616:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787251.103798:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.103815:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.103827:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787251.104014:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787787251.104024:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395285884960ns, next at 396285882485ns, rc = 0 00000004:00010000:1.0:1787787251.104071:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0691758 reply state 00000000df7db2c5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.104086:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.104093:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:1.0:1787787251.104097:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787787251.104100:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787251.104228:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11283:x1874630484735616:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 530us (1218us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787787251.104235:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:2.0:1787787251.111546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.111848:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484735744 00000100:00100000:0.0:1787787251.111949:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484735744 00000100:00100000:0.0:1787787251.112111:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:0.0:1787787251.112122:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11283:x1874630484735744:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787251.112360:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787251.112386:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81ce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.112464:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.112482:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.112514:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:0.0:1787787251.112518:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787251.112523:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a200, rc 0) 00000100:00100000:0.0:1787787251.112938:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:11283:x1874630484735744:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 816us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.112946:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:2.0:1787787251.116390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.116488:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484735872 00000100:00100000:0.0:1787787251.116497:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484735872 00000100:00100000:0.0:1787787251.116599:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:0.0:1787787251.116615:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1874630484735872:12345-192.168.204.31@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787787251.116650:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:0.0:1787787251.116677:0:8441:0:(genops.c:1385:class_connect()) connect: client 99b164f2-528a-4a42-8406-031dcbc8cfdb, cookie 0x11620bc3f30a9323 00002000:00100000:0.0:1787787251.116690:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99b164f2-528a-4a42-8406-031dcbc8cfdb/ffff986fc38bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787787251.116712:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787787251.117072:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787787251.117107:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9870c3e9c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787251.117273:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2390:x1874630484735872:12345-192.168.204.31@tcp:8:lhsmtool_posix.0 Request processed in 664us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.117291:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:2.0:1787787251.119646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.119816:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484736000 00000100:00100000:3.0:1787787251.119825:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484736000 00000100:00100000:3.0:1787787251.119932:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:3.0:1787787251.119944:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:0:x1874630484736000:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787787251.120677:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787787251.122709:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1787787251.122723:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000100:00100000:2.0:1787787251.124401:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:0:x1874630484736000:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 4448us (4752us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787787251.124416:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:3.0:1787787251.139016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.139082:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484736256 00000100:00100000:0.0:1787787251.139093:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484736256 00000100:00100000:0.0:1787787251.139948:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:0.0:1787787251.139963:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:11283:x1874630484736256:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787251.140247:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11283:x1874630484736256:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 287us (1240us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787787251.140256:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787251.144398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.144460:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484736512 00000100:00100000:3.0:1787787251.144471:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484736512 00000100:00100000:3.0:1787787251.144547:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:3.0:1787787251.144566:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11283:x1874630484736512:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787787251.144690:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11283:x1874630484736512:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 133us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.144697:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:1.0:1787787251.149189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.149340:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484736640 00000100:00100000:3.0:1787787251.149350:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484736640 00000100:00100000:3.0:1787787251.149410:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:3.0:1787787251.149421:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11283:x1874630484736640:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787251.149441:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787251.149461:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a932a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81d5 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.149543:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9331 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.149559:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.149570:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787251.149625:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787251.149646:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.149672:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a932a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81d5 expref: 20 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.149711:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81d5 expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.149720:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:3.0:1787787251.149723:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787787251.149726:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:3.0:1787787251.149799:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11283:x1874630484736640:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 380us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.149807:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:1.0:1787787251.154576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.154665:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484736768 00000100:00100000:3.0:1787787251.154675:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484736768 00000100:00100000:3.0:1787787251.154747:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:3.0:1787787251.154756:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484736768:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787251.154774:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787251.154797:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81dc expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787251.154822:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f77f3, blocks: 0x0 00010000:00010000:3.0:1787787251.154842:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1787787251.154847:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787251.154858:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 6 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.154878:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 6 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.155182:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:3.0:1787787251.155293:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484736768:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 537us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.155301:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:0.0:1787787251.163040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.163130:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737024 00000100:00100000:3.0:1787787251.163161:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737024 00000100:00100000:3.0:1787787251.163231:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:3.0:1787787251.163242:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11283:x1874630484737024:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787787251.163357:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11283:x1874630484737024:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 116us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.163365:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:1.0:1787787251.168946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.169025:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737152 00000100:00100000:0.0:1787787251.169036:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737152 00000100:00100000:0.0:1787787251.169097:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:0.0:1787787251.169107:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:11283:x1874630484737152:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787251.169125:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787251.169172:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81e3 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.169204:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 7 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.169214:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787251.169219:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787251.169224:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.169278:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 7 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.169294:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 7 pid: 8443 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.169309:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8441:1874630503691904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787251.169409:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787251.171952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787251.172029:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737280 00000100:00100000:0.0:1787787251.172038:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8441:1874630503691904:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787251.172045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737280 00010000:00010000:0.0:1787787251.172074:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.172095:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8aa00, rc 0) 00010000:00010000:1.0:1787787251.172097:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 8 pid: 8443 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.172158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:1.0:1787787251.172168:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484737280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787251.172182:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787787251.172186:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:11283:x1874630484737152:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 3077us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.172195:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 36 00010000:00010000:1.0:1787787251.172205:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 8 pid: 8443 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.172221:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 7 pid: 8443 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.172256:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a9338 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81dc expref: 7 pid: 8443 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.172269:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787251.172273:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787251.172280:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.172293:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.172321:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.172345:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42943c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6513:1874630503692032:192.168.204.31@tcp:105: 00000100:00100000:1.0:1787787251.172410:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787251.187943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.188117:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42943c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6513:1874630503692032:192.168.204.31@tcp:105: 00010000:00010000:0.0:1787787251.188162:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787251.188220:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484737280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 16052us (16281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.188232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:2.0:1787787251.188446:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737408 00000100:00100000:2.0:1787787251.188454:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737408 00002000:00100000:2.0:1787787251.188514:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9870ffaca940 x1874630484737408/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:112/0 lens 504/0 e 0 to 0 dl 1787787262 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787251.188525:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870ffaca940 with x1874630484737408 ext(0->8) 00002000:00010000:2.0:1787787251.188531:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9870ffaca940 00000100:00100000:2.0:1787787251.188560:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:2.0:1787787251.188570:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffaca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484737408:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787787251.198782:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffaca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484737408:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 Request processed in 10205us (10842us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787787251.198804:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00002000:00100000:1.0:1787787251.198819:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9870ffaca940 x1874630484737408/t4294967303(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:112/0 lens 504/448 e 0 to 0 dl 1787787262 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787787251.198829:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870ffaca940 with x1874630484737408 ext(0->8) 00002000:00010000:1.0:1787787251.198836:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9870ffaca940 00000100:00100000:0.0:1787787251.230416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.230462:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737536 00000100:00100000:0.0:1787787251.230489:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737536 00000100:00100000:0.0:1787787251.230566:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:0.0:1787787251.230576:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11283:x1874630484737536:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787787251.238834:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787787251.238850:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787787251.238881:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787787251.238916:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787787251.238927:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787787251.239129:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:11283:x1874630484737536:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 Request processed in 8549us (8718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.239162:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 90 00010000:00010000:3.0:1787787251.239569:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.239581:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.239589:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.239595:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454ea00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787251.239600:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.239632:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.239650:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:3.0:1787787251.239653:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787787251.239657:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.239663:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a9315 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.247305:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503692160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787787251.247390:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787251.247431:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503692160 00000100:00100000:3.0:1787787251.247442:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503692160 00000100:00100000:3.0:1787787251.247597:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787251.247610:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503692160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787787251.247743:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787787251.247747:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787787251 00002000:00010000:3.0:1787787251.247750:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787787251.247753:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787787251 -> 1787787251 00002000:00010000:3.0:1787787251.247756:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787787251.247811:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503692160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (421us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787787251.247821:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1787787251.247876:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc4295680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787787251.247883:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503692160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787787251.247948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.247976:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737664 00000100:00100000:3.0:1787787251.247990:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737664 00000100:00100000:0.0:1787787251.251106:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:0.0:1787787251.251125:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484737664:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787787251.255992:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787787251.256011:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1787787251.260732:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484737664:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 Request processed in 9603us (12775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.260746:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:3.0:1787787251.283298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.284367:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484737920 00000100:00100000:2.0:1787787251.284381:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484737920 00000100:00100000:2.0:1787787251.284437:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:2.0:1787787251.284447:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484737920:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787251.285035:0:13825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787251.285085:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9331 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81d5 expref: 14 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.285105:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:2.0:1787787251.285111:0:13825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787251.285589:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.285606:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.285618:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787251.285745:0:13825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a5c175f reply state 000000009f34c559 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.285759:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.285765:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:2.0:1787787251.285767:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787251.285770:0:13825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787251.285887:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:11283:x1874630484737920:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 1439us (2600us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787787251.285896:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:3.0:1787787251.304682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.304999:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484738048 00000100:00100000:0.0:1787787251.305011:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484738048 00000100:00100000:0.0:1787787251.305087:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:0.0:1787787251.305098:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffaca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484738048:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787787251.305308:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787787251.305312:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787787251 -> 1787787250 00002000:00010000:0.0:1787787251.305315:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787787248 00002000:00010000:0.0:1787787251.305318:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787787251 -> 1787787250 00002000:00010000:0.0:1787787251.305320:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787787251.305390:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffaca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484738048:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 293us (720us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787787251.305399:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:3.0:1787787251.330097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.330134:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484738304 00000100:00100000:3.0:1787787251.330156:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484738304 00000100:00100000:3.0:1787787251.330213:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:3.0:1787787251.330225:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:11283:x1874630484738304:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787787251.330297:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.330315:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 15 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.330324:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.330359:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 15 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.330374:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 15 pid: 13672 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.330389:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffacbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503692288:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787251.330883:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787251.336279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.339934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484738432 00000100:00100000:2.0:1787787251.339948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484738432 00010000:00010000:2.0:1787787251.340008:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 16 pid: 13672 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787251.340072:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787251.340082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:2392:x1874630484738432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787251.340098:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787251.340106:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 16 pid: 13672 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.340118:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 16 pid: 13672 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.340159:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:2.0:1787787251.340165:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.340175:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.340183:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.340204:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787251.340262:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:2392:x1874630484738432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 181us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787251.340270:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00010000:00010000:0.0:1787787251.342205:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a930e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81c7 expref: 15 pid: 13672 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.342238:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffacbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503692288:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787251.342266:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342276:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342282:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342320:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342329:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342336:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342343:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787251.342348:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342354:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342369:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:0.0:1787787251.342373:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787787251.342378:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.342392:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a934d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.342483:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484738304:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 Request processed in 12259us (12395us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787787251.342493:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:3.0:1787787251.345585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.345686:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484738560 00000100:00100000:0.0:1787787251.345696:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484738560 00000100:00100000:0.0:1787787251.345755:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:0.0:1787787251.345767:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484738560:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787787251.345812:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.345832:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.345840:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787251.345845:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787251.345849:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.345883:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.345910:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 7 pid: 8441 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.345947:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8443:1874630503692416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787251.346044:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787251.349103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.349128:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8443:1874630503692416:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787251.349185:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.349622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484738688 00000100:00100000:1.0:1787787251.349629:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484738688 00010000:00010000:1.0:1787787251.349668:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 8 pid: 8441 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.349711:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:1.0:1787787251.349721:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484738688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787251.349738:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787251.349760:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 8 pid: 8441 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.349805:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 8 pid: 8441 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.349831:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c89490a/0x11620bc3f30a933f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81e3 expref: 8 pid: 8441 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.349949:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787251.349955:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787251.349961:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.349972:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.350008:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787251.350060:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484738688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 340us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787251.350069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00010000:00010000:0.0:1787787251.350084:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350096:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350117:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350126:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350133:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350159:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787251.350163:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350185:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350200:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.350208:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9354 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.350257:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2394:x1874630484738560:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 Request processed in 4494us (4682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.350266:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:0.0:1787787251.354512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.354691:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484738944 00000100:00100000:3.0:1787787251.354701:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484738944 00000100:00100000:3.0:1787787251.354768:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00100000:3.0:1787787251.354778:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11283:x1874630484738944:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787787251.354855:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.354872:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.354883:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.354945:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.354962:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 14 pid: 6529 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.354977:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4283840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503692544:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787251.355074:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787251.362366:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503692544:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787251.362380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1787787251.362400:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.362640:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484739072 00000100:00100000:0.0:1787787251.362648:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484739072 00010000:00010000:0.0:1787787251.362685:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 15 pid: 6529 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.362724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:0.0:1787787251.362735:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:2391:x1874630484739072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787251.362749:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787251.362756:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 15 pid: 6529 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.362779:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 15 pid: 6529 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.362803:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a919b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c816c expref: 15 pid: 6529 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.362821:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787251.362826:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.362835:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.362843:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.362867:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787251.362985:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:2391:x1874630484739072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 251us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.362993:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00010000:00010000:1.0:1787787251.363159:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.363169:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.363366:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.363379:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.363388:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.363418:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.363433:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 14 pid: 6527 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.363447:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503692672:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787251.363511:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc41129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787251.367301:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503692672:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787251.367337:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.369325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.369610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484739200 00000100:00100000:3.0:1787787251.369620:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484739200 00010000:00010000:3.0:1787787251.369664:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 15 pid: 6527 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.369698:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:3.0:1787787251.369707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:2392:x1874630484739200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787251.369723:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787251.369730:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 15 pid: 6527 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.369744:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 15 pid: 6527 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.369767:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a931c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ce expref: 15 pid: 6527 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.369844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:3.0:1787787251.369849:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.369859:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.369867:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.369902:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787251.369933:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.369942:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.369965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:2392:x1874630484739200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 257us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.369975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000001:00080000:2.0:1787787251.370055:0:7753:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787787251.370208:0:7753:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787787251.370250:0:7753:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787787251.370334:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7753:1874630503692800:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787787251.370385:0:7753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787251.370432:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f58523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787251.370537:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503692800 00000100:00100000:1.0:1787787251.370543:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503692800 00000100:00100000:1.0:1787787251.370588:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787787251.370597:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7753:x1874630503692800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787787251.370677:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7753:x1874630503692800:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787251.370689:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787787251.370766:0:7753:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787787251.370773:0:7753:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff986fc4295680, transno 4294967304 00000100:00100000:3.0:1787787251.370794:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3950000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7753:1874630503692800:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787787251.370928:0:7753:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1787787251.370973:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7753:1874630503692928:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787787251.371004:0:7753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787251.371025:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787251.371040:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503692928 00000100:00100000:3.0:1787787251.371044:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503692928 00000100:00100000:3.0:1787787251.371068:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787787251.371073:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7753:x1874630503692928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787787251.371192:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7753:x1874630503692928:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (186us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787787251.371200:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787787251.371235:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7753:1874630503692928:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787787251.371276:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371286:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371293:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371300:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.371304:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371311:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371324:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:1.0:1787787251.371328:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787251.371332:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371339:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a9362 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371373:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371379:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371385:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371399:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787251.371403:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371409:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371418:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:1.0:1787787251.371420:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787251.371423:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371429:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9290 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371452:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371466:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371475:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371512:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.371527:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 17 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.371551:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503693056:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787251.371618:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787251.378061:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503693056:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787251.378095:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.378380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.378431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484739328 00000100:00100000:0.0:1787787251.378439:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484739328 00010000:00010000:0.0:1787787251.378476:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 18 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.378552:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:0.0:1787787251.378562:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2391:x1874630484739328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787251.378578:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787251.378586:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 18 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.378599:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 18 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.378622:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a92ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81b2 expref: 18 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.378638:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:0.0:1787787251.378643:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.378652:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.378659:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.378691:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787251.378738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:2391:x1874630484739328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 177us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787251.378747:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00010000:00010000:2.0:1787787251.378802:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378810:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378822:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378829:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378835:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378841:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787251.378845:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378853:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378862:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787251.378865:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787251.378878:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378885:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9369 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378911:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378918:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378923:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378929:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787251.378933:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378940:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378948:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d974b000) 00010000:00010000:2.0:1787787251.378951:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787251.378953:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.378959:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a935b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787251.379232:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11283:x1874630484738944:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 24456us (24740us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787787251.379241:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 93 00000020:00080000:2.0:1787787251.379251:0:7753:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787787251.379696:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787251.379702:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787251.379718:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787787251.379725:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787251.384494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.384988:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484739584 00000100:00100000:0.0:1787787251.385017:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484739584 00000100:00100000:0.0:1787787251.385084:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787251.385095:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11283:x1874630484739584:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787787251.385425:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787787251.385468:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787787251.385520:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.385539:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.385551:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.385560:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.385566:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.385571:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.385595:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787251.385653:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787251.385665:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.385675:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787251.385702:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.385713:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.385713:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11283:x1874630484739584:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 618us (1227us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787787251.385733:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00010000:00010000:3.0:1787787251.385739:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00000020:00080000:0.0:1787787251.385740:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787787251.385746:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787787251.385751:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.385758:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9370 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.385782:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787251.385785:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787251.385786:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787251.498460:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787251.695621:0:14217:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787251.695630:0:14217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787251.695653:0:14217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787787251.695664:0:14217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787251.846625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787251.848024:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484739840 00000100:00100000:1.0:1787787251.848038:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484739840 00000100:00100000:1.0:1787787251.848109:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:1.0:1787787251.848120:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:11293:x1874630484739840:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787251.848157:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787251.848178:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81ea expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.848290:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a937e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.848304:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a937e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.848317:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a937e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787251.848326:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787787251.848425:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a9377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ea expref: 21 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.848445:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a937e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ea expref: 20 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.848467:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:1.0:1787787251.848470:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787251.848474:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454ea00, rc 0) 00000100:00100000:1.0:1787787251.848558:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:11293:x1874630484739840:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 440us (1944us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787787251.848565:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:1.0:1787787251.854566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.854706:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484739968 00000100:00100000:3.0:1787787251.854717:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484739968 00000100:00100000:3.0:1787787251.854849:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:3.0:1787787251.854861:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:11293:x1874630484739968:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1787787251.854938:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.854957:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.854969:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.854985:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855009:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855016:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855100:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855108:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855114:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787251.855195:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855207:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855212:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855218:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855224:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787251.855227:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855234:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855253:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787251.855255:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787251.855260:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855266:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a938c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855280:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855286:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855292:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855296:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787251.855299:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855305:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855312:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc2a19100) 00010000:00010000:3.0:1787787251.855314:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787251.855317:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855323:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9393 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855349:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855356:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855363:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855368:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787251.855372:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855378:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855386:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff986fc2a19200) 00010000:00010000:3.0:1787787251.855389:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787251.855392:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.855398:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a939a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.855481:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:11293:x1874630484739968:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 622us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.855500:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:3.0:1787787251.919031:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.919205:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484740224 00000100:00100000:0.0:1787787251.919215:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484740224 00000100:00100000:0.0:1787787251.919276:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:0.0:1787787251.919288:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:11296:x1874630484740224:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787251.919308:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787251.919330:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a93a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81f1 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919416:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919432:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919444:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919460:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919467:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919473:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919590:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919599:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919619:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787251.919628:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787787251.919708:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919715:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919722:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919728:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8be00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787251.919732:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919740:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919752:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787251.919755:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787251.919759:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919765:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a93a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919777:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919782:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919795:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919800:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787251.919803:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919809:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919816:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9870d4cec000) 00010000:00010000:0.0:1787787251.919819:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787251.919822:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919828:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.919991:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a93a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 23 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.920006:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 22 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.920013:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:0.0:1787787251.920015:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787251.920017:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b600, rc 0) 00000100:00100000:0.0:1787787251.920076:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11296:x1874630484740224:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 791us (1065us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787787251.920093:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:1.0:1787787251.925622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.928953:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484740352 00000100:00100000:2.0:1787787251.928969:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484740352 00000100:00100000:2.0:1787787251.929106:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:2.0:1787787251.929118:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11296:x1874630484740352:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:2.0:1787787251.929204:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929220:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929231:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929269:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929277:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929284:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929290:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787251.929294:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929302:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929315:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787251.929318:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787251.929339:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.929346:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.929651:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11296:x1874630484740352:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 533us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787251.929661:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:1.0:1787787251.934954:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.935041:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484740608 00000100:00100000:3.0:1787787251.935052:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484740608 00000100:00100000:3.0:1787787251.935127:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:3.0:1787787251.935173:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3665450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11296:x1874630484740608:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787251.935398:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3665450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:11296:x1874630484740608:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 261us (455us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787787251.935421:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:3.0:1787787251.972253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787251.972401:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484740864 00000100:00100000:0.0:1787787251.972421:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484740864 00000100:00100000:0.0:1787787251.972498:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 98 00000100:00100000:0.0:1787787251.972509:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:10821:x1874630484740864:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787251.972534:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787251.972555:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a93cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81f8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.972839:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.972855:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 24 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.972864:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.972895:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 24 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.972909:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 24 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787251.972923:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efa580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503693184:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787251.973387:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787251.976322:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efa580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503693184:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787251.976364:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787251.979689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787251.981720:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484740992 00000100:00100000:1.0:1787787251.981739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484740992 00010000:00010000:1.0:1787787251.981793:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 25 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787251.981896:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:1.0:1787787251.981919:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:2391:x1874630484740992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787251.981936:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787251.981944:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 25 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.981959:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 25 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.982002:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a93b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f1 expref: 25 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.982023:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:1.0:1787787251.982028:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.982039:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.982047:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787251.982082:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787251.982322:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:2391:x1874630484740992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 416us (2796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787251.982330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00010000:00010000:0.0:1787787251.982404:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.982413:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787251.982433:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787787251.982588:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a93cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.982615:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787251.982624:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:0.0:1787787251.982627:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787787251.982630:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a600, rc 0) 00000100:00100000:0.0:1787787251.982657:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:10821:x1874630484740864:12345-192.168.204.31@tcp:101:bash.0 Request processed in 10151us (10415us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787787251.982671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 98 00000100:00100000:1.0:1787787251.985878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.986063:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484741120 00000100:00100000:2.0:1787787251.986074:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484741120 00000100:00100000:2.0:1787787251.986299:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 99 00000100:00100000:2.0:1787787251.986312:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:10821:x1874630484741120:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787251.986337:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787251.986370:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c81ff expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.986405:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a93e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.986420:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a93e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.986432:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a93e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.986570:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a93e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ff expref: 26 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.986589:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a93e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ff expref: 25 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.986598:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787251.986618:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787251.986623:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787251.986688:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:10821:x1874630484741120:12345-192.168.204.31@tcp:101:bash.0 Request processed in 379us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787251.986703:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 99 00000100:00100000:0.0:1787787251.991477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787251.991710:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484741376 00000100:00100000:2.0:1787787251.991723:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484741376 00000100:00100000:2.0:1787787251.991836:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 100 00000100:00100000:2.0:1787787251.991846:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:10821:x1874630484741376:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:2.0:1787787251.992100:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.992117:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.992129:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787251.992222:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1787787251.992248:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028220e3e reply state 00000000c554c45e transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.992262:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787251.992270:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787251.992272:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787251.992276:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787787251.992316:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1787787251.992422:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:10821:x1874630484741376:12345-192.168.204.31@tcp:36:bash.0 Request processed in 576us (959us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787787251.992448:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 100 00000020:00080000:2.0:1787787251.992454:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787787251.994725:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.994810:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484741504 00000100:00100000:3.0:1787787251.994819:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484741504 00000100:00100000:3.0:1787787251.994879:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 101 00000100:00100000:3.0:1787787251.994889:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:10821:x1874630484741504:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787251.994923:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787251.994945:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a93f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8206 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.995004:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a93f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8206 expref: 30 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.995018:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a93f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8206 expref: 30 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.995036:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:3.0:1787787251.995040:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787251.995043:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:3.0:1787787251.995109:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:10821:x1874630484741504:12345-192.168.204.31@tcp:101:bash.0 Request processed in 221us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.995117:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 101 00000100:00100000:0.0:1787787251.998749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787251.998892:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484741632 00000100:00100000:3.0:1787787251.998900:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484741632 00000100:00100000:3.0:1787787251.998972:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:3.0:1787787251.998981:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:10821:x1874630484741632:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787251.998999:0:13816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787251.999019:0:13816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c820d expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787251.999043:0:13816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f77f2, atime: 0x6a8f77f0, ctime: 0x6a8f77f2, blocks: 0x8 00010000:00010000:3.0:1787787251.999064:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787787251.999078:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787251.999459:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.999482:0:13816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 7 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787251.999508:0:13816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:3.0:1787787251.999629:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:10821:x1874630484741632:12345-192.168.204.31@tcp:101:bash.0 Request processed in 647us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787251.999638:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:1.0:1787787252.005747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.005874:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484741760 00000100:00100000:0.0:1787787252.005883:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484741760 00002000:00010000:0.0:1787787252.005994:0:8447:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1787787252.005999:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc4297c00 with x1874630484741760 ext(0->18446744073709551615) 00002000:00010000:0.0:1787787252.006012:0:8447:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc4297c00. 00000100:00100000:0.0:1787787252.006061:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:0.0:1787787252.006071:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484741760:12345-192.168.204.31@tcp:10:bash.0 00002000:00010000:0.0:1787787252.006417:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787787252.006421:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787787250 -> 1787787252 00002000:00010000:0.0:1787787252.006423:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787787248 -> 1787787248 00002000:00010000:0.0:1787787252.006425:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787787250 -> 1787787252 00002000:00010000:0.0:1787787252.006428:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787787252.006507:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484741760:12345-192.168.204.31@tcp:10:bash.0 Request processed in 436us (769us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787787252.006516:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00002000:00010000:0.0:1787787252.006520:0:8447:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1787787252.006523:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc4297c00 with x1874630484741760 ext(0->18446744073709551615) 00002000:00010000:0.0:1787787252.006528:0:8447:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc4297c00. 00000100:00100000:1.0:1787787252.116617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.116726:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484741888 00000100:00100000:0.0:1787787252.116736:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484741888 00000100:00100000:0.0:1787787252.116801:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 102 00000100:00100000:0.0:1787787252.116810:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11310:x1874630484741888:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:0.0:1787787252.116881:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.116897:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.116908:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.116922:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.116943:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.116951:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117022:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117032:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117039:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787252.117083:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117095:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117102:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117108:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117114:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787252.117118:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117126:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117184:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787252.117186:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787252.117191:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117196:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a9403 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117209:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117214:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117219:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117224:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8be00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787252.117227:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117232:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117239:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9870d4cec000) 00010000:00010000:0.0:1787787252.117241:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787252.117244:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117250:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a940a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117279:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117285:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117292:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117296:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8ac00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787252.117299:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117305:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117313:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:0.0:1787787252.117316:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787252.117319:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.117324:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a9411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787252.117388:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11310:x1874630484741888:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 579us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787252.117395:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 102 00000100:00100000:1.0:1787787252.167366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.168752:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484742144 00000100:00100000:2.0:1787787252.168768:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484742144 00000100:00100000:3.0:1787787252.169133:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 103 00000100:00100000:3.0:1787787252.169166:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11313:x1874630484742144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787252.169185:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787252.169207:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9418 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8214 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169307:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169322:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169335:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169352:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169371:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169380:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169504:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a942d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169524:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a942d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169531:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a942d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787252.169541:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787787252.169620:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169638:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169645:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169651:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787252.169656:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169663:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169678:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787252.169680:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787252.169685:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169691:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a941f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169707:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169713:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169719:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169723:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787252.169733:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169740:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169748:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc2a19d00) 00010000:00010000:3.0:1787787252.169751:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787252.169754:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169759:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9426 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169813:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9418 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8214 expref: 33 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169828:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a942d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8214 expref: 32 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.169835:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:3.0:1787787252.169837:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787787252.169840:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7a00, rc 0) 00000100:00100000:3.0:1787787252.170391:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11313:x1874630484742144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1226us (3035us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787787252.170401:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 103 00000100:00100000:1.0:1787787252.177555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.177634:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484742272 00000100:00100000:0.0:1787787252.177644:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484742272 00000100:00100000:0.0:1787787252.177711:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00100000:0.0:1787787252.177736:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11313:x1874630484742272:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:0.0:1787787252.177825:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.177843:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 32 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.177856:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.177892:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 32 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.178364:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 32 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787252.178383:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ef8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503693312:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787252.178551:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787252.185999:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ef8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503693312:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787252.186035:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787252.186196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.186917:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484742528 00000100:00100000:3.0:1787787252.186926:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484742528 00000100:00100000:3.0:1787787252.186987:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:3.0:1787787252.186997:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+33:6161:x1874630484742528:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787787252.187547:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:6161:x1874630484742528:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 549us (1349us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787787252.187557:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787252.191615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.191725:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484742656 00000100:00100000:0.0:1787787252.191736:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484742656 00010000:00010000:0.0:1787787252.191778:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 34 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787252.191821:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:0.0:1787787252.191845:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:2392:x1874630484742656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787252.191861:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787252.191868:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 34 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.191882:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 34 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.191903:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a93d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81f8 expref: 34 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.191931:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:0.0:1787787252.191935:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.191944:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.191951:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.191987:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787252.192066:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+33:2392:x1874630484742656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 223us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787252.192074:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00010000:00010000:1.0:1787787252.192270:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192290:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192340:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192348:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192355:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192360:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8ac00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787252.192365:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192372:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192392:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:1.0:1787787252.192396:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787252.192400:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.192405:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a943b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787252.192452:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11313:x1874630484742272:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 14719us (14919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.192461:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00100000:1.0:1787787252.195512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.195758:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484742912 00000100:00100000:3.0:1787787252.195769:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484742912 00000100:00100000:3.0:1787787252.195827:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1787787252.195838:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:11313:x1874630484742912:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787252.196224:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+33:11313:x1874630484742912:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 386us (719us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787787252.196233:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:0.0:1787787252.301941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.302110:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484743168 00000100:00100000:2.0:1787787252.302121:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484743168 00000100:00100000:2.0:1787787252.302221:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 105 00000100:00100000:2.0:1787787252.302232:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+33:11324:x1874630484743168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1787787252.302261:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787252.302285:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c821b expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.302367:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.302383:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.302395:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.302411:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.302418:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.302437:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303521:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9457 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303658:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303668:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787252.303679:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787787252.303756:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303763:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303770:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303776:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.303780:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303788:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303799:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787252.303802:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.303806:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303827:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9449 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303841:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303848:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303853:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303857:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.303860:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303865:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303872:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:2.0:1787787252.303874:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.303877:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303883:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303929:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c821b expref: 36 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303955:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c821b expref: 35 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.303962:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787252.303964:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787252.303966:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2400, rc 0) 00000100:00100000:2.0:1787787252.304093:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11324:x1874630484743168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1863us (2163us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787787252.304102:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 105 00000100:00100000:2.0:1787787252.317991:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.320724:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484743424 00000100:00100000:3.0:1787787252.320740:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484743424 00000100:00100000:3.0:1787787252.320805:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1787787252.320815:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11324:x1874630484743424:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1787787252.321202:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+36:11324:x1874630484743424:12345-192.168.204.31@tcp:35:cat.0 Request processed in 386us (3220us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787787252.321211:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1787787252.355314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.357858:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484743680 00000100:00100000:2.0:1787787252.357873:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484743680 00000100:00100000:2.0:1787787252.357950:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 106 00000100:00100000:2.0:1787787252.357962:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+36:11325:x1874630484743680:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1787787252.358021:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787787252.358049:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a93f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8206 expref: 36 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358075:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9457 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c821b expref: 35 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358089:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a942d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8214 expref: 34 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358102:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a93e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ff expref: 33 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358390:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787252.358396:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787252.358516:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358703:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358717:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358734:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358742:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358749:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358831:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358839:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.358847:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787252.359063:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787787252.359073:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396540934576ns, next at 397540931840ns, rc = 0 00010000:00010000:2.0:1787787252.359604:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359617:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359625:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359633:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359638:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359644:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359666:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787252.359686:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359692:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359697:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359702:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.359706:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359712:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359728:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787252.359731:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787787252.359735:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359740:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9473 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359757:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359764:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359769:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359774:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.359776:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359782:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359788:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787252.359790:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.359793:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359798:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a9465 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787252.359814:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afb4440e reply state 000000008766e4dc transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359824:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.359829:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:2.0:1787787252.359831:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787252.359834:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787252.359919:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:11325:x1874630484743680:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1956us (4612us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787787252.359927:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 106 00010000:00010000:1.0:1787787252.360196:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787252.360203:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.360209:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787252.360212:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.360219:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.360229:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:1.0:1787787252.360231:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787787252.360234:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.360239:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a947a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.360250:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787252.360252:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787252.360253:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787252.419753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787252.419817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.419837:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484743808 00000100:00100000:2.0:1787787252.419847:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484743808 00000100:00100000:1.0:1787787252.419853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787252.419885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.419902:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 379 00000100:00100000:1.0:1787787252.419902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.419912:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484743808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787252.419920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787252.419964:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744320 00000100:00100000:1.0:1787787252.419973:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744320 00000100:00100000:2.0:1787787252.419984:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484743808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787252.419991:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 379 00000100:00100000:1.0:1787787252.420020:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484743936 00000100:00100000:2.0:1787787252.420021:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744448 00000100:00100000:2.0:1787787252.420024:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744448 00000100:00100000:1.0:1787787252.420024:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484743936 00000100:00100000:3.0:1787787252.420084:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744064 00000100:00100000:3.0:1787787252.420089:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744064 00000100:00100000:3.0:1787787252.420116:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744192 00000100:00100000:3.0:1787787252.420119:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744192 00000100:00100000:3.0:1787787252.420167:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:3.0:1787787252.420175:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484744064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787252.420203:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484744064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.420220:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:3.0:1787787252.420234:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:3.0:1787787252.420241:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484744192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787252.420266:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484744192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.420272:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:1.0:1787787252.420545:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 285 00000100:00100000:1.0:1787787252.420557:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484744320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787252.420590:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484744320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.420597:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 285 00000100:00100000:1.0:1787787252.420610:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 286 00000100:00100000:1.0:1787787252.420616:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484743936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787252.420639:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484743936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.420646:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 286 00000100:00100000:1.0:1787787252.420657:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 287 00000100:00100000:1.0:1787787252.420663:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484744448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787252.420685:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484744448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.420691:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 287 00000100:00080000:2.0:1787787252.423888:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787252.423899:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787252.423902:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787252.444626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787252.445238:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744704 00000100:00100000:2.0:1787787252.445248:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744704 00000100:00100000:2.0:1787787252.445355:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 107 00000100:00100000:2.0:1787787252.445367:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:11331:x1874630484744704:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787252.445407:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787252.445428:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9481 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8222 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.445554:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.445570:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.445581:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.445592:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.445599:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.445605:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787252.445921:0:13672:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787787252.446200:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446209:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446217:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446263:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446270:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446276:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446281:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.446285:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446293:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446305:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787252.446308:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.446312:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446318:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9488 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787252.446332:0:13672:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071b6c4ec reply state 000000004455e691 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446344:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446350:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:2.0:1787787252.446359:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787252.446362:0:13672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787787252.446393:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9481 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 37 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446409:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 36 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.446416:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:2.0:1787787252.446418:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787252.446421:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787252.446502:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:11331:x1874630484744704:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1137us (1970us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787787252.446510:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 107 00000100:00100000:2.0:1787787252.458362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.458536:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744832 00000100:00100000:3.0:1787787252.458545:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744832 00000100:00100000:3.0:1787787252.458613:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:3.0:1787787252.458623:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3952940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484744832:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787252.458642:0:13816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787252.458663:0:13816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8229 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787252.458689:0:13816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787252.458708:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787787252.458712:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787252.458721:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 8 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.458739:0:13816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 8 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.458752:0:13816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:3.0:1787787252.458824:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3952940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2394:x1874630484744832:12345-192.168.204.31@tcp:101:bash.0 Request processed in 203us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.458832:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:1.0:1787787252.464771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.464906:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484744960 00000100:00100000:3.0:1787787252.464917:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484744960 00000100:00100000:3.0:1787787252.464985:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:3.0:1787787252.464996:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:11331:x1874630484744960:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787252.465016:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787252.465034:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8230 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.465077:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 9 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.465087:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787252.465091:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787252.465097:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.465132:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 9 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.465191:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 9 pid: 13816 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787252.465205:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8444:1874630503693440:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787252.465325:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cac600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787252.471172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787252.471261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484745088 00000100:00100000:1.0:1787787252.471269:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484745088 00010000:00010000:1.0:1787787252.471309:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 10 pid: 13816 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787252.471342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:1.0:1787787252.471352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484745088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787252.471380:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787252.471400:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 10 pid: 13816 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.471414:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 10 pid: 13816 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.471450:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787252.471455:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787252.471464:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.471486:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.471539:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787252.471554:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6513:1874630503693568:192.168.204.31@tcp:105: 00000100:00100000:1.0:1787787252.471649:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112180 going to sleep for 11 seconds 00010000:00010000:3.0:1787787252.471837:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a94a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8229 expref: 10 pid: 13816 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787252.471854:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8444:1874630503693440:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787252.471878:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.471888:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7000, rc 0) 00000100:00100000:3.0:1787787252.471918:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:11331:x1874630484744960:12345-192.168.204.31@tcp:101:bash.0 Request processed in 6924us (7158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.471926:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1787787252.478345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787252.478345:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6513:1874630503693568:192.168.204.31@tcp:105: 00010000:00010000:1.0:1787787252.478372:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787252.478843:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484745344 00000100:00100000:3.0:1787787252.478851:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484745344 00000100:00100000:3.0:1787787252.478909:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:3.0:1787787252.478919:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:11331:x1874630484745344:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:1.0:1787787252.479405:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484745088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8053us (8275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.479417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:3.0:1787787252.480401:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11331:x1874630484745344:12345-192.168.204.31@tcp:35:bash.0 Request processed in 1478us (2053us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787787252.480413:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00010000:00010000:3.0:1787787252.523325:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787252.716010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.716307:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484745472 00000100:00100000:3.0:1787787252.716318:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484745472 00000100:00100000:2.0:1787787252.716662:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 108 00000100:00100000:2.0:1787787252.716673:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:11347:x1874630484745472:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787252.716706:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787252.716727:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a94b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8237 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.716788:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a94b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.716803:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a94b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.716828:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a94b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787252.716873:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787787252.716877:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787252.716897:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a94b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.716920:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a94b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8237 expref: 40 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.716939:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a94b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8237 expref: 39 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.716947:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787252.716950:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787252.716954:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787252.717020:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:11347:x1874630484745472:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 349us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787252.717028:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 108 00000100:00100000:2.0:1787787252.721998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.722084:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484745728 00000100:00100000:0.0:1787787252.722093:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484745728 00000100:00100000:0.0:1787787252.722351:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 109 00000100:00100000:0.0:1787787252.722374:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:11347:x1874630484745728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787252.722396:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787252.722417:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a94c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c823e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.722557:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.722572:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.722582:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787252.722592:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787787252.722766:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a94c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c823e expref: 42 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.722786:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c823e expref: 41 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.722795:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:0.0:1787787252.722798:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787252.722801:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8bc00, rc 0) 00000100:00100000:0.0:1787787252.722859:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+41:11347:x1874630484745728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 487us (869us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787787252.722866:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 109 00000100:00100000:1.0:1787787252.728347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.728464:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484745984 00000100:00100000:0.0:1787787252.728487:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484745984 00000100:00100000:0.0:1787787252.728568:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 110 00000100:00100000:0.0:1787787252.728578:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+41:11347:x1874630484745984:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787252.728601:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787252.728622:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a94d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8245 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.729027:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a94dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.729042:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a94dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.729058:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a94dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787252.729072:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787787252.729206:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a94d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8245 expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.729225:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a94dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8245 expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.729234:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:0.0:1787787252.729237:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787787252.729239:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a200, rc 0) 00000100:00100000:0.0:1787787252.729304:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:11347:x1874630484745984:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 728us (967us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787787252.729313:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 110 00000100:00100000:3.0:1787787252.729355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.729484:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484746112 00000100:00100000:0.0:1787787252.729499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484746112 00000100:00100000:0.0:1787787252.729541:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:0.0:1787787252.729549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:2392:x1874630484746112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787252.729560:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787252.729576:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c823e expref: 43 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.729588:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:0.0:1787787252.729592:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787252.729618:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+42:2392:x1874630484746112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787252.729624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787252.734509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.740865:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484746240 00000100:00100000:0.0:1787787252.740882:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484746240 00000100:00100000:0.0:1787787252.740951:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:0.0:1787787252.740960:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484746240:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1787787252.741002:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.741023:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.741032:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787252.741037:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787252.741042:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.741096:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 8 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.741111:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 8 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787252.741125:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8443:1874630503693696:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787252.741424:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3adea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787252.758248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.758374:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8443:1874630503693696:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787252.758405:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787252.763324:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484746368 00000100:00100000:3.0:1787787252.763340:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484746368 00002000:00100000:3.0:1787787252.763404:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9870c3ee0b40 x1874630484746368/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:113/0 lens 504/0 e 0 to 0 dl 1787787263 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787252.763429:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870c3ee0b40 with x1874630484746368 ext(0->8) 00010000:00010000:3.0:1787787252.763440:0:8449:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 9 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.763459:0:8449:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 9 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787252.763467:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9870c3ee0b40 00000100:00100000:3.0:1787787252.764427:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1787787252.764449:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484746368:12345-192.168.204.31@tcp:4:lfs.0 00000100:00100000:3.0:1787787252.765698:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:2392:x1874630484746368:12345-192.168.204.31@tcp:4:lfs.0 Request processed in 1250us (7453us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787787252.765711:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00002000:00100000:3.0:1787787252.765723:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9870c3ee0b40 x1874630484746368/t4294967303(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:113/0 lens 504/448 e 0 to 0 dl 1787787263 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787252.765734:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870c3ee0b40 with x1874630484746368 ext(0->8) 00010000:00010000:3.0:1787787252.765817:0:8449:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 11 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.765839:0:8449:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 11 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787252.765848:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9870c3ee0b40 00000100:00100000:1.0:1787787252.786721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.787432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484746496 00000100:00100000:0.0:1787787252.787443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484746496 00010000:00010000:0.0:1787787252.787500:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 11 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787252.787551:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:0.0:1787787252.787561:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:2391:x1874630484746496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787252.787577:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787787252.787595:0:6513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787787252.787598:0:6513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787787252 00002000:00010000:0.0:1787787252.787600:0:6513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787787252 00002000:00010000:0.0:1787787252.787602:0:6513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787787252 00002000:00010000:0.0:1787787252.787618:0:6513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787787252.787636:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 11 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.787652:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 11 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.787677:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d36be4/0x11620bc3f30a94ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8230 expref: 11 pid: 8444 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.787703:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787252.787708:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787252.787714:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.787725:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.787765:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787252.787821:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2391:x1874630484746496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 261us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787252.787829:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00010000:00010000:1.0:1787787252.788355:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788367:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788391:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788399:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788408:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788416:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787252.788421:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788429:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788443:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787252.788464:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3cb08c9/0x11620bc3f30a94ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787252.788545:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484746240:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 47585us (54190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.788553:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1787787252.792859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787252.798868:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484746752 00000100:00100000:0.0:1787787252.798886:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484746752 00000100:00100000:0.0:1787787252.799028:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:0.0:1787787252.799040:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3665850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+42:11347:x1874630484746752:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:0.0:1787787252.799121:0:6531:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a94dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8245 expref: 42 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787252.799402:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787787252.799436:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787787252.799772:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1787787252.799815:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.799831:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 46 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.799841:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.799874:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 46 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787252.799890:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 46 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787252.799906:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3efad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874630503693824:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787252.800004:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d2379cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787252.820583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.820736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484746880 00000100:00100000:3.0:1787787252.820765:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484746880 00010000:00010000:3.0:1787787252.820811:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 47 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787252.820860:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:3.0:1787787252.820870:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4143c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:2392:x1874630484746880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787252.820891:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787252.820898:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 47 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.820913:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 47 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.820939:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:3.0:1787787252.820945:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.820953:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.820960:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.820980:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787252.821043:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4143c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:2392:x1874630484746880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 174us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.821052:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00010000:00010000:1.0:1787787252.822052:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8222 expref: 46 pid: 13672 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787252.822071:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3efad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874630503693824:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787252.822293:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.822354:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.822362:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787252.822487:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1787787252.822606:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787787252.822683:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4142580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503693952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787787252.822733:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787252.822767:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787252.822825:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503693952 00000100:00100000:3.0:1787787252.822831:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503693952 00000100:00100000:3.0:1787787252.822889:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787787252.822897:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1874630503693952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787252.822970:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1874630503693952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.822977:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1787787252.823285:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787252.823312:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4142580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503693952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787787252.823427:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1787787252.823467:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e92c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503694080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787787252.823531:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787252.823544:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787252.823598:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503694080 00000100:00100000:3.0:1787787252.823603:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503694080 00000100:00100000:3.0:1787787252.823629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787787252.823635:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1874630503694080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787252.823720:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6531:x1874630503694080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (199us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787787252.823727:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787787252.823850:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e92c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503694080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787787252.823877:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1787787252.823901:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.823912:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.823919:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.823925:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.823929:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.823936:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.823955:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:2.0:1787787252.823958:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787787252.823963:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.823969:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a94f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787252.824048:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787787252.824097:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787787252.824108:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397005968884ns, next at 398005966503ns, rc = 0 00000001:00080000:2.0:1787787252.824113:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1787787252.824675:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:2.0:1787787252.824681:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787787252.824689:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a94dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8245 expref: 50 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787252.824869:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3665850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+49:11347:x1874630484746752:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 25830us (32018us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787787252.824878:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000020:00080000:2.0:1787787252.824882:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787787252.828512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.828891:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484747008 00000100:00100000:3.0:1787787252.828901:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484747008 00000100:00100000:3.0:1787787252.829037:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 111 00000100:00100000:3.0:1787787252.829049:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+49:11347:x1874630484747008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787252.829072:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787252.829304:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a94f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c824c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.829370:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a94f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c824c expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.829386:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a94f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c824c expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787252.829406:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787252.829427:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787252.829431:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:3.0:1787787252.829502:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:11347:x1874630484747008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 456us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.829508:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 111 00000100:00100000:1.0:1787787252.842365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787252.842540:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484747264 00000100:00100000:3.0:1787787252.842551:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484747264 00000100:00100000:3.0:1787787252.842613:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787252.842623:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:11347:x1874630484747264:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787252.842889:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+51:11347:x1874630484747264:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 266us (535us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787787252.842897:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:0.0:1787787252.939513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787252.942759:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484747392 00000100:00100000:1.0:1787787252.942774:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484747392 00000100:00100000:2.0:1787787252.943112:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 112 00000100:00100000:2.0:1787787252.943124:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+51:11358:x1874630484747392:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:2.0:1787787252.943215:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943233:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943259:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943271:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943279:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943285:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943355:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943364:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943371:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787252.943432:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943445:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943452:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943459:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943489:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.943493:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943502:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943514:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787252.943527:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.943533:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943539:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a94ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943553:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943560:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943566:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943571:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.943574:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943580:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943607:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:2.0:1787787252.943610:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.943614:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943620:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9506 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943630:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943636:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943642:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943646:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787252.943649:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943655:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943662:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787252.943664:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787252.943668:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787252.943673:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a950d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787252.943764:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+51:11358:x1874630484747392:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 641us (4259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787252.943772:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 112 00000100:00100000:1.0:1787787253.020369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.020475:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484747648 00000100:00100000:3.0:1787787253.020486:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484747648 00000100:00080000:2.0:1787787253.020728:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787253.020812:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 113 00000100:00100000:3.0:1787787253.020836:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+51:11361:x1874630484747648:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787253.020858:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787253.020881:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9514 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8253 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021111:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021128:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021171:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021195:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021204:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021212:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021328:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021338:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021346:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787253.021357:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787787253.021440:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021448:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021456:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021461:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.021477:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021496:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021512:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787253.021744:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.021752:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021759:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a951b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021776:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021782:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021789:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021794:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.021797:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021802:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021811:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:3.0:1787787253.021814:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.021886:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021903:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9522 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021956:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9514 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 54 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021972:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 53 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.021980:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.021983:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787253.022054:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391000, rc 0) 00000100:00100000:3.0:1787787253.022220:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:11361:x1874630484747648:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1397us (1860us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787787253.022228:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 113 00000100:00100000:1.0:1787787253.026442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.026761:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484747776 00000100:00100000:2.0:1787787253.026772:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484747776 00000100:00100000:2.0:1787787253.026879:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:2.0:1787787253.026890:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:11361:x1874630484747776:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:2.0:1787787253.026956:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.026974:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.026995:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027028:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027035:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027041:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027047:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.027051:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027074:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027086:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.027089:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787253.027094:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.027100:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9537 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.027202:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:11361:x1874630484747776:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 313us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.027210:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:0.0:1787787253.030419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.030507:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484748032 00000100:00100000:3.0:1787787253.030517:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484748032 00000100:00100000:3.0:1787787253.030575:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:3.0:1787787253.030585:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:11361:x1874630484748032:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787253.031081:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11361:x1874630484748032:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 497us (672us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1787787253.031091:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:0.0:1787787253.097767:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787253.097793:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503694336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787253.097878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787253.098171:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503694336 00000100:00100000:1.0:1787787253.098179:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503694336 00000100:00100000:2.0:1787787253.098390:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787253.098401:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503694208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787253.098435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787787253.101433:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787253.101784:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503694208 00000100:00100000:1.0:1787787253.101796:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503694208 00000100:00100000:1.0:1787787253.101854:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787787253.101875:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503694336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787253.101903:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787253.101978:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503694336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.102010:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787787253.102030:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787787253.102036:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3653:x1874630503694208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787253.102047:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787253.102089:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3653:x1874630503694208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (3654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.102095:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787787253.106593:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503694336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787253.106658:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503694208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787253.116841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.117074:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484748288 00000100:00100000:0.0:1787787253.117085:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484748288 00000100:00100000:0.0:1787787253.117265:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:0.0:1787787253.117276:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11371:x1874630484748288:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787253.117307:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787253.117311:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787787253.117339:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a94b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8237 expref: 54 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.117359:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:0.0:1787787253.117364:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787253.117377:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a953e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c825a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.117491:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.117504:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 54 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.117512:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.119217:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 54 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.119238:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 54 pid: 13672 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.119256:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503694464:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787253.119371:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787253.128593:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.129099:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503694464:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787253.129126:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.129838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484748416 00000100:00100000:3.0:1787787253.129847:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484748416 00010000:00010000:3.0:1787787253.129948:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 55 pid: 13672 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.130115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:3.0:1787787253.130126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:2392:x1874630484748416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787253.130167:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787253.130175:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 55 pid: 13672 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.130190:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 55 pid: 13672 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.130215:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a9529 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8253 expref: 55 pid: 13672 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.130231:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.130236:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.130245:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.130251:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.130284:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787253.130337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:2392:x1874630484748416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 213us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.130345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00010000:00010000:2.0:1787787253.130402:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.130410:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787253.130435:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787787253.130602:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a953e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 55 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.130619:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 54 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.130627:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.130630:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787253.130633:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8aa00, rc 0) 00000100:00100000:2.0:1787787253.130658:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11371:x1874630484748288:12345-192.168.204.31@tcp:101:bash.0 Request processed in 13385us (13828us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787787253.130665:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:0.0:1787787253.133773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.133936:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484748544 00000100:00100000:2.0:1787787253.133948:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484748544 00000100:00100000:2.0:1787787253.134112:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:2.0:1787787253.134125:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:11371:x1874630484748544:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787253.134166:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787253.134188:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9553 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8261 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.134225:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.134240:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.134270:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.134384:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9553 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 56 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.134402:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 55 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.134410:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.134413:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787253.134416:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787253.134546:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:11371:x1874630484748544:12345-192.168.204.31@tcp:101:bash.0 Request processed in 424us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.134553:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:1.0:1787787253.139297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.139417:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484748800 00000100:00100000:3.0:1787787253.139439:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484748800 00000100:00100000:3.0:1787787253.139503:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:3.0:1787787253.139511:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:11371:x1874630484748800:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:3.0:1787787253.139840:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.140281:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.140295:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787253.140336:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1787787253.140359:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5fd9e93 reply state 0000000021f92948 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.140370:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.140377:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.140380:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787253.140383:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787253.140487:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11371:x1874630484748800:12345-192.168.204.31@tcp:36:bash.0 Request processed in 975us (1199us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787787253.140494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 117 00000020:00080000:3.0:1787787253.140499:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787787253.143777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.143936:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484748928 00000100:00100000:2.0:1787787253.143946:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484748928 00000100:00100000:2.0:1787787253.144095:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:2.0:1787787253.144105:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11371:x1874630484748928:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787253.144130:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787253.144185:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9568 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8268 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.144282:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.144300:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 59 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.144323:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.144357:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 59 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.144372:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 59 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.144386:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503694592:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787253.144488:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787253.147818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.148439:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503694592:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787253.148487:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.148650:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484749056 00000100:00100000:1.0:1787787253.148658:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484749056 00010000:00010000:1.0:1787787253.148700:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 60 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.148745:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:1.0:1787787253.148754:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:2391:x1874630484749056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787253.148781:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787253.148788:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 60 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.148800:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 60 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.148832:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a9545 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c825a expref: 60 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.148848:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:1.0:1787787253.148853:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.148863:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.148871:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.148900:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787253.148953:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:2391:x1874630484749056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 200us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.148970:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00010000:00010000:2.0:1787787253.149337:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.149346:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787253.149401:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787787253.149406:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787253.149429:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.149461:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9568 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 59 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.149489:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 58 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.149512:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.149515:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787253.149518:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3400, rc 0) 00000100:00100000:2.0:1787787253.149560:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11371:x1874630484748928:12345-192.168.204.31@tcp:101:bash.0 Request processed in 5456us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.149568:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:0.0:1787787253.153035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.153109:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484749312 00000100:00100000:2.0:1787787253.153119:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484749312 00000100:00100000:2.0:1787787253.153208:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:2.0:1787787253.153217:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:11371:x1874630484749312:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:2.0:1787787253.153418:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11371:x1874630484749312:12345-192.168.204.31@tcp:35:bash.0 Request processed in 202us (391us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787787253.153425:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:1.0:1787787253.230056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.230267:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484749440 00000100:00100000:3.0:1787787253.230278:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484749440 00000100:00100000:3.0:1787787253.230346:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:3.0:1787787253.230357:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:11377:x1874630484749440:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787253.230413:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787253.230436:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c826f expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.230515:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a957d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.230529:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.230542:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787253.230603:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787787253.230607:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787253.230626:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.230650:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c826f expref: 61 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.230670:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a957d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c826f expref: 60 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.230679:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787253.230682:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787253.230685:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7000, rc 0) 00000100:00100000:3.0:1787787253.230742:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11377:x1874630484749440:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 386us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.230750:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:0.0:1787787253.235532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.235724:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484749568 00000100:00100000:2.0:1787787253.235735:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484749568 00000100:00100000:2.0:1787787253.235798:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:2.0:1787787253.235808:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11377:x1874630484749568:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787253.235840:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787253.235871:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9584 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8276 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.235935:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.235949:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.235976:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236001:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236009:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236015:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236087:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236096:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236103:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787253.236180:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787787253.236184:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787253.236202:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236215:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236222:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236237:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236243:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236249:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.236253:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236259:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236271:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787253.236275:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787253.236279:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236285:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a958b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236298:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236304:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236310:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236314:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.236323:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236330:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236338:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:2.0:1787787253.236340:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787253.236343:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236349:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9592 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236375:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9584 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 62 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236389:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 61 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.236396:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.236398:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787253.236400:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787253.236476:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11377:x1874630484749568:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 669us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.236485:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:0.0:1787787253.244873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.244935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.245190:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484749952 00000100:00100000:1.0:1787787253.245203:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484749952 00000100:00100000:1.0:1787787253.245263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:1.0:1787787253.245274:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11377:x1874630484749952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787253.245303:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787253.245328:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a95a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c827d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.245843:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.245861:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 62 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.245870:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 62 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.245878:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.245913:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 62 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.245928:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 62 pid: 13825 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.245941:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503694720:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787253.246124:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 62 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.246244:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484749696 00000100:00100000:3.0:1787787253.246249:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484749696 00010000:00010000:3.0:1787787253.246275:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 63 pid: 13825 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.246312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:3.0:1787787253.246321:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:2391:x1874630484749696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787253.246331:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787253.246337:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 63 pid: 13825 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.246874:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 63 pid: 7753 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.246900:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503694848:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787253.246955:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112780 going to sleep for 11 seconds 00010000:00010000:3.0:1787787253.248725:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 63 pid: 13825 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.248762:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.248768:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.248778:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.248785:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787253.248896:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:2391:x1874630484749696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2574us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.248907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00010000:00010000:1.0:1787787253.253294:0:6528:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@00000000b94d8fb9 x1874630503694720) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 62 pid: 13825 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.253320:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9599 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8276 expref: 62 pid: 13825 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.253338:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503694720:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787253.253351:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503694848:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787253.253375:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:1.0:1787787253.253381:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.253390:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.253399:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.256039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.256366:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484750080 00000100:00100000:3.0:1787787253.256376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484750080 00010000:00010000:3.0:1787787253.256416:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 62 pid: 7753 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.256487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:3.0:1787787253.256497:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:2391:x1874630484750080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787253.256517:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787253.256525:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 62 pid: 7753 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.256539:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 62 pid: 7753 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.256563:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a956f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8268 expref: 62 pid: 7753 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.256590:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.256603:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.256613:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.256619:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.256650:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787253.256706:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:2391:x1874630484750080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 211us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.256714:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00010000:00010000:1.0:1787787253.256821:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.256839:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787253.256866:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787787253.257010:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a95a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 62 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.257028:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.257035:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:1.0:1787787253.257037:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787253.257040:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e600, rc 0) 00000100:00100000:1.0:1787787253.257066:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11377:x1874630484749952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 11795us (12131us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787787253.257073:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:0.0:1787787253.262059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.262321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484750336 00000100:00100000:3.0:1787787253.262346:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484750336 00000100:00100000:3.0:1787787253.262403:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:3.0:1787787253.262413:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11377:x1874630484750336:12345-192.168.204.31@tcp:103:lfs.0 00010000:00010000:3.0:1787787253.262431:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787253.262458:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a94f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c824c expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.262490:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.262494:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787253.262561:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11377:x1874630484750336:12345-192.168.204.31@tcp:103:lfs.0 Request processed in 150us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.262569:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1787787253.266290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.266422:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484750464 00000100:00100000:3.0:1787787253.266432:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484750464 00000100:00100000:3.0:1787787253.266503:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:3.0:1787787253.266514:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc39503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11377:x1874630484750464:12345-192.168.204.31@tcp:58:lfs.0 00010000:00010000:3.0:1787787253.266677:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.266698:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.266711:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787253.266811:0:13672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787787253.266898:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc39503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11377:x1874630484750464:12345-192.168.204.31@tcp:58:lfs.0 Request processed in 385us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.266906:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:2.0:1787787253.271229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.271347:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484750592 00000100:00100000:0.0:1787787253.271358:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484750592 00000100:00100000:0.0:1787787253.271423:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:0.0:1787787253.271434:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:11377:x1874630484750592:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787253.271456:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787253.271489:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8284 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.271551:0:13825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.271561:0:13825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 61 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.271589:0:13825:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.271612:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 61 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.271626:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:0.0:1787787253.271629:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787253.271633:0:13825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 61 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.271639:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b600, rc 0) 00000100:00100000:0.0:1787787253.271708:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11377:x1874630484750592:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 276us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787253.271716:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 123 00000040:00080000:3.0:1787787253.417439:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787253.417449:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787253.417486:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787787253.417498:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787253.417825:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503694976:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787253.418028:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cacd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787253.434197:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503694976:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787787253.437038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.437132:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484750720 00000100:00100000:2.0:1787787253.437169:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484750720 00000100:00100000:2.0:1787787253.437244:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:2.0:1787787253.437254:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11378:x1874630484750720:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787253.437288:0:7753:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787253.437426:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11378:x1874630484750720:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 173us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.437434:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:0.0:1787787253.443425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.443728:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484750848 00000100:00100000:3.0:1787787253.443739:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484750848 00000100:00100000:3.0:1787787253.443835:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:3.0:1787787253.443849:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11378:x1874630484750848:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787787253.443933:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.443952:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.443963:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.443981:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.443988:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.443995:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444019:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444043:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444051:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787253.444103:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787787253.444108:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787253.444123:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444174:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444182:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444189:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444195:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.444200:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444207:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444219:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:3.0:1787787253.444223:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.444227:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444243:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a95c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444260:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444266:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444271:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444276:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.444279:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444285:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444292:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff986fc2a19800) 00010000:00010000:3.0:1787787253.444295:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.444298:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444304:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c1391000/0x11620bc3f30a95ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444320:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444325:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444336:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444341:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.444344:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444350:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444357:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.444359:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.444362:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.444367:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a95d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.444445:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11378:x1874630484750848:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 Request processed in 600us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.444453:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:0.0:1787787253.447806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.448018:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484751104 00000100:00100000:2.0:1787787253.448027:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484751104 00000100:00100000:3.0:1787787253.448114:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:3.0:1787787253.448127:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3951e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:11378:x1874630484751104:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787253.448286:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787253.448310:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a95d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c828b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448410:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448425:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448437:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787253.448449:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787787253.448704:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448712:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448719:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448742:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.448747:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448755:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448767:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.448770:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787787253.448775:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448782:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a95df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448831:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a95d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c828b expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448841:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:2.0:1787787253.448843:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787253.448847:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a95d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c828b expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.448857:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787253.448960:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3951e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:11378:x1874630484751104:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 836us (1164us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787787253.448968:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:1.0:1787787253.452116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.452416:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484751232 00000100:00100000:2.0:1787787253.452442:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484751232 00000100:00100000:2.0:1787787253.452702:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:2.0:1787787253.452714:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:11378:x1874630484751232:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787253.452751:0:7753:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787253.452860:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:11378:x1874630484751232:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 148us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.452868:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:0.0:1787787253.456474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.456652:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484751488 00000100:00100000:2.0:1787787253.456662:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484751488 00000100:00100000:2.0:1787787253.456726:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:2.0:1787787253.456736:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:11378:x1874630484751488:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787253.456759:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787253.456763:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787787253.456793:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a957d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c826f expref: 62 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.456815:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787253.456820:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787253.456834:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a95ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8292 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787253.457474:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787787253.457760:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a95f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.457774:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a95f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.457798:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a95f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.457856:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a95ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8292 expref: 64 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.457872:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a95f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8292 expref: 63 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.457880:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:2.0:1787787253.457882:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787253.457885:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3600, rc 0) 00000100:00100000:2.0:1787787253.457953:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:11378:x1874630484751488:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 1218us (1501us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787787253.457961:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:0.0:1787787253.461989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.462081:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484751744 00000100:00100000:2.0:1787787253.462091:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484751744 00000100:00100000:2.0:1787787253.462231:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00100000:2.0:1787787253.462242:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:11378:x1874630484751744:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787253.462302:0:13825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787253.462330:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a95f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8292 expref: 63 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462347:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1dd00) 00010000:00010000:2.0:1787787253.462358:0:13825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787253.462379:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462407:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462417:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462433:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462440:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462447:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462503:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462520:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462526:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462532:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.462536:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462544:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462551:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:2.0:1787787253.462571:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787253.462576:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462582:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9602 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462592:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462598:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462604:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462609:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.462611:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462617:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462625:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6e6385cd (ffff986fc3a1da00) 00010000:00010000:2.0:1787787253.462627:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787253.462630:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.462636:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9609 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6e6385cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.462765:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:11378:x1874630484751744:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 524us (786us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787253.462778:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00100000:1.0:1787787253.468541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.469439:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484751872 00000100:00100000:2.0:1787787253.469452:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484751872 00000100:00100000:2.0:1787787253.469530:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:2.0:1787787253.469540:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:11378:x1874630484751872:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787253.469785:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787253.469813:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9610 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8299 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.469853:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.469868:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.469880:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.469995:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9610 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 64 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.470015:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 63 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.470024:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787253.470027:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787253.470030:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787253.470173:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:11378:x1874630484751872:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 634us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.470188:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:0.0:1787787253.483591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.483789:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484752128 00000100:00100000:3.0:1787787253.483798:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484752128 00000100:00100000:3.0:1787787253.483864:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 131 00000100:00100000:3.0:1787787253.483876:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:11378:x1874630484752128:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787253.483961:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.483993:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.484005:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787253.484214:0:13672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787787253.484226:0:13672:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397666086741ns, next at 398666083591ns, rc = 0 00000004:00010000:3.0:1787787253.484289:0:13672:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003919aba4 reply state 00000000d79b6317 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.484303:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.484311:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787253.484314:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787787253.484318:0:13672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787253.484486:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:11378:x1874630484752128:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 611us (905us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787787253.484494:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 131 00000100:00100000:0.0:1787787253.494262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.494702:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484752256 00000100:00100000:1.0:1787787253.494712:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484752256 00000100:00100000:1.0:1787787253.494779:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:1.0:1787787253.494789:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:11378:x1874630484752256:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787253.494815:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787253.494837:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82a0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.494890:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.494924:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.494944:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:1.0:1787787253.494947:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787253.494951:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f454e800, rc 0) 00000100:00100000:1.0:1787787253.495078:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:11378:x1874630484752256:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 290us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.495086:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:1.0:1787787253.506960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.514567:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484752384 00000100:00100000:0.0:1787787253.514584:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484752384 00000100:00100000:0.0:1787787253.514692:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:0.0:1787787253.514704:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484752384:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787787253.515042:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787253.515234:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484752384:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 531us (8282us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787787253.515244:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:1.0:1787787253.519721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.519952:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484752640 00000100:00100000:2.0:1787787253.519963:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484752640 00000100:00100000:2.0:1787787253.520022:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787253.520032:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:11378:x1874630484752640:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787787253.520288:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:11378:x1874630484752640:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 257us (578us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787787253.520296:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787253.524128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.524291:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484752896 00000100:00100000:0.0:1787787253.524303:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484752896 00000100:00100000:0.0:1787787253.524366:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:0.0:1787787253.524377:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:11378:x1874630484752896:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787253.524496:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:11378:x1874630484752896:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 121us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787253.524503:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:1.0:1787787253.527360:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.527434:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753024 00000100:00100000:3.0:1787787253.527445:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753024 00000100:00100000:3.0:1787787253.527520:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:3.0:1787787253.527531:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:11378:x1874630484753024:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787253.527552:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787253.527580:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a962c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82a7 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.527765:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9633 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.527779:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.527790:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787253.527833:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787253.527849:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.527873:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a962c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a7 expref: 69 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.527892:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a7 expref: 68 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.527901:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787253.527904:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787787253.527907:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:3.0:1787787253.527971:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:11378:x1874630484753024:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 442us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.527977:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:1.0:1787787253.534865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.535005:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753152 00000100:00100000:3.0:1787787253.535015:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753152 00000100:00100000:3.0:1787787253.535083:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:3.0:1787787253.535108:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484753152:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787253.535126:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787253.535176:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82ae expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787253.535201:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f77f5, blocks: 0x0 00010000:00010000:3.0:1787787253.535220:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1787787253.535225:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787253.535234:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 10 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.535253:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 10 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.535268:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031c00, rc 0) 00000100:00100000:3.0:1787787253.535322:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2391:x1874630484753152:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 216us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.535329:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00010000:00010000:1.0:1787787253.548877:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787253.555253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.555349:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753408 00000100:00100000:1.0:1787787253.555358:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753408 00000100:00100000:1.0:1787787253.555416:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:1.0:1787787253.555426:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:11378:x1874630484753408:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787787253.555569:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:11378:x1874630484753408:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.555579:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:1.0:1787787253.559897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.560270:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753536 00000100:00100000:0.0:1787787253.560280:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753536 00000100:00100000:0.0:1787787253.560360:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:0.0:1787787253.560370:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:11378:x1874630484753536:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787253.560387:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787253.560482:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82b5 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.560515:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.560524:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787253.560528:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787253.560534:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 11 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.560580:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.560801:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.560817:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffac9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8443:1874630503695104:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787253.560922:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d23790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787253.564217:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffac9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8443:1874630503695104:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787253.564252:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 11 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.564294:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a000, rc 0) 00000100:00100000:1.0:1787787253.564346:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:11378:x1874630484753536:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 3978us (4458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.564355:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:2.0:1787787253.567255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.567541:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753664 00000100:00100000:1.0:1787787253.567551:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753664 00010000:00010000:1.0:1787787253.567666:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.567714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:1.0:1787787253.567724:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:2392:x1874630484753664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787253.567740:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787253.567767:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.567783:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.567807:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec72f45/0x11620bc3f30a963a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ae expref: 11 pid: 8444 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.567823:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787253.567828:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787253.567835:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.567858:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.567894:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.567909:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cd2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6513:1874630503695232:192.168.204.31@tcp:105: 00000100:00100000:1.0:1787787253.568410:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787253.571574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.571678:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cd2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6513:1874630503695232:192.168.204.31@tcp:105: 00010000:00010000:1.0:1787787253.571703:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787253.571763:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484753664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4039us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.571774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:0.0:1787787253.572270:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753792 00000100:00100000:0.0:1787787253.572279:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753792 00002000:00100000:0.0:1787787253.572325:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff986fc4142580 x1874630484753792/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:114/0 lens 504/0 e 0 to 0 dl 1787787264 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787787253.572352:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc4142580 with x1874630484753792 ext(0->12) 00002000:00010000:0.0:1787787253.572356:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc4142580 00000100:00100000:0.0:1787787253.572389:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:0.0:1787787253.572399:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4142580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484753792:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787787253.573469:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4142580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:2392:x1874630484753792:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 Request processed in 1055us (1899us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787787253.573481:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00002000:00100000:0.0:1787787253.573490:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff986fc4142580 x1874630484753792/t4294967309(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:114/0 lens 504/448 e 0 to 0 dl 1787787264 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787787253.573500:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc4142580 with x1874630484753792 ext(0->12) 00002000:00010000:0.0:1787787253.573505:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc4142580 00000100:00100000:2.0:1787787253.579107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.579211:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484753920 00000100:00100000:0.0:1787787253.579221:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484753920 00000100:00100000:0.0:1787787253.579318:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:0.0:1787787253.579327:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4143c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:11378:x1874630484753920:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787787253.583279:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787787253.583305:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787787253.583348:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787787253.583367:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870f5852180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787787253.583373:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3759600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870f5852240 00000020:00080000:0.0:1787787253.583376:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3759100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870d2304a00 00000004:00080000:0.0:1787787253.583400:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787787253.583427:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870e08326c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787787253.583447:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3ba4900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870e0832780 00000020:00080000:0.0:1787787253.583450:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3ba4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870fc2f3600 00000020:00080000:0.0:1787787253.583492:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1787787253.583831:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503695360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787787253.583913:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787253.583970:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503695360 00000100:00100000:3.0:1787787253.583990:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503695360 00000100:00100000:3.0:1787787253.584039:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787253.584047:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3655:x1874630503695360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787787253.584072:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1787787253.584111:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f77f4, atime: 0x6a8f77f4, ctime: 0x6a8f77f4, blocks: 0x8 00010000:00010000:3.0:1787787253.584120:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584157:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1787787253.584163:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787253.584169:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584185:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584195:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584203:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584220:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787253.584341:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3655:x1874630503695360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 294us (427us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787787253.584347:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1787787253.584369:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787253.584375:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584383:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787253.584396:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584405:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584421:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584428:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a9648 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.584447:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787253.584449:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787253.584450:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787787253.584490:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc4281a40/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787787253.584496:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503695360:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787787253.584814:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787787253.584922:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4143c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11378:x1874630484753920:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 Request processed in 5595us (5824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787253.584931:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:2.0:1787787253.585112:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787253.585123:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503695616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787787253.585198:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787253.585234:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503695616 00000100:00100000:2.0:1787787253.585238:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503695616 00000100:00100000:2.0:1787787253.585276:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787787253.585283:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503695616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787787253.585379:0:13816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787787253.585382:0:13816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787787253 00002000:00010000:2.0:1787787253.585384:0:13816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787787253.585386:0:13816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787787253 -> 1787787253 00002000:00010000:2.0:1787787253.585388:0:13816:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787787253.585420:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3654:x1874630503695616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (223us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787787253.585434:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1787787253.585478:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9870fc2e5a40/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787787253.585484:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503695616:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787787253.585977:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787253.585987:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787253.586106:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503695488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787787253.586167:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787253.586198:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503695488 00000100:00100000:3.0:1787787253.586202:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503695488 00000100:00100000:3.0:1787787253.586229:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787253.586236:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3655:x1874630503695488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787787253.586252:0:9030:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1787787253.586269:0:9030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.586296:0:9030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 11 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.586305:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787787253.586310:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787253.586314:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.586342:0:9030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 11 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.586358:0:9030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 11 pid: 13816 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.586370:0:9030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9030:1874630503695744:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787253.586416:0:9030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cacd80 going to sleep for 11 seconds 00010000:00010000:1.0:1787787253.592228:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592247:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592253:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.592257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1787787253.592261:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787253.592265:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592293:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592311:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff986fc3a1c900) 00000100:00100000:0.0:1787787253.592311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1787787253.592314:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787253.592319:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592326:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9346 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.592334:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484754176 00000100:00100000:0.0:1787787253.592343:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484754176 00010000:00010000:1.0:1787787253.592353:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592358:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592363:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592367:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787253.592370:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592375:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592377:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 12 pid: 13816 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592383:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:1.0:1787787253.592385:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787253.592388:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592402:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a93ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.592407:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:0.0:1787787253.592415:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:2392:x1874630484754176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787253.592416:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592422:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592427:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592430:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787253.592432:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787253.592435:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592435:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 12 pid: 13816 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592442:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592448:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 12 pid: 13816 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592449:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:1.0:1787787253.592452:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787253.592466:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592472:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a946c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592480:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787253.592481:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592484:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787253.592487:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592489:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592498:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592503:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787253.592504:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592506:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592523:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.592525:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787253.592531:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff986fc3a1d100) 00010000:00010000:1.0:1787787253.592533:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787253.592536:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592541:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a948f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592554:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.592565:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:2392:x1874630484754176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 151us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1787787253.592568:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.592573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 75 00010000:00010000:1.0:1787787253.592574:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.592579:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787253.592581:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.592667:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484754048 00000100:00100000:2.0:1787787253.592673:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484754048 00000100:00100000:2.0:1787787253.592711:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:2.0:1787787253.592717:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:2392:x1874630484754048:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787787253.592723:0:9030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063eefdee/0x11620bc3f30a93fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c820d expref: 12 pid: 13816 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.592736:0:9030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9030:1874630503695744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787253.592758:0:9030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592767:0:9030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592781:0:9030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592789:0:9030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592795:0:9030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592810:0:9030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787253.592868:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787253.592873:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592879:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787253.592883:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592890:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592904:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592912:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30a964f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.592933:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787253.592935:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787253.592937:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787253.593746:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593759:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:1.0:1787787253.593762:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787253.593766:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593772:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9561 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593790:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593795:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593801:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593805:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787253.593808:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593813:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593820:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:1.0:1787787253.593823:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787787253.593825:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.593841:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a961e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.594905:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3655:x1874630503695488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8664us (8731us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787787253.594915:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1787787253.595367:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9870fc2e4f00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787787253.595375:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503695488:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787787253.596900:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787787253.596912:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787787253.598258:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484754048:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 Request processed in 5530us (5994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.598272:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:0.0:1787787253.601881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.601925:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484754432 00000100:00100000:3.0:1787787253.601935:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484754432 00000100:00100000:3.0:1787787253.601999:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:3.0:1787787253.602010:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11378:x1874630484754432:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787253.602065:0:13672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787253.602096:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9633 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a7 expref: 16 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.602117:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787253.602122:0:13672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787253.602283:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.602297:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.602307:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787253.602443:0:13672:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c191a836 reply state 0000000043066ca7 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.602468:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.602497:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787253.602500:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787253.602503:0:13672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787253.602617:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:11378:x1874630484754432:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 608us (744us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1787787253.602625:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:1.0:1787787253.605527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.605619:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484754560 00000100:00100000:3.0:1787787253.605629:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484754560 00000100:00100000:3.0:1787787253.605700:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:3.0:1787787253.605713:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484754560:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787787253.605878:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787787253.605882:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787787253 -> 1787787253 00002000:00010000:3.0:1787787253.605885:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787787252 00002000:00010000:3.0:1787787253.605887:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787787253 -> 1787787253 00002000:00010000:3.0:1787787253.605889:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787787253.605961:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484754560:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 251us (447us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787787253.605969:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:0.0:1787787253.608568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.608744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484754816 00000100:00100000:1.0:1787787253.608754:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484754816 00000100:00100000:1.0:1787787253.608814:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:1.0:1787787253.608824:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:11378:x1874630484754816:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787787253.608889:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.608906:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.608915:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.608948:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.608962:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 17 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.608995:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503695872:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787253.609210:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787253.611987:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503695872:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787253.612019:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.612496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.612683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484754944 00000100:00100000:1.0:1787787253.612691:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484754944 00010000:00010000:1.0:1787787253.612730:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 18 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.612767:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:1.0:1787787253.612776:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2392:x1874630484754944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787253.612790:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787253.612798:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 18 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.612811:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 18 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.612834:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9617 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8299 expref: 18 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.612850:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:1.0:1787787253.612855:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.612864:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.612888:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.612916:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787253.612967:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:2392:x1874630484754944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 192us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.612975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 76 00010000:00010000:2.0:1787787253.613036:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613045:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613084:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613091:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613104:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613111:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.613115:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613124:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613133:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787253.613172:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787787253.613177:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.613183:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e000/0x11620bc3f30a965d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.613224:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11378:x1874630484754816:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 Request processed in 4402us (4666us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787787253.613232:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:1.0:1787787253.615486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.615535:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484755072 00000100:00100000:0.0:1787787253.615546:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484755072 00000100:00100000:0.0:1787787253.615609:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:0.0:1787787253.615619:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2393:x1874630484755072:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787787253.615675:0:13816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.615695:0:13816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.615704:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787253.615708:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787253.615712:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.615764:0:13816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.615779:0:13816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 7 pid: 8443 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.615794:0:13816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffac8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13816:1874630503696000:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787253.615878:0:13816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d2379cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787253.619619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.619813:0:13816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffac8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13816:1874630503696000:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787253.619841:0:13816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.620626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484755200 00000100:00100000:1.0:1787787253.620636:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484755200 00010000:00010000:1.0:1787787253.620736:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 8 pid: 8443 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.620778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:1.0:1787787253.620788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484755200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787253.620805:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787253.620827:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 8 pid: 8443 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.620842:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 8 pid: 8443 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.620866:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748fadd3/0x11620bc3f30a9641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82b5 expref: 8 pid: 8443 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.620883:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787253.620902:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787253.620908:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.620919:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.620954:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787253.621013:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484755200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 225us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.621021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00010000:00010000:0.0:1787787253.621322:0:13816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621333:0:13816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621354:0:13816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621363:0:13816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621383:0:13816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621391:0:13816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787253.621395:0:13816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621404:0:13816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621416:0:13816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.621423:0:13816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000645bf419/0x11620bc3f30a9664 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.621490:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484755072:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 Request processed in 5873us (6013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787253.621498:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:3.0:1787787253.624373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.624493:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484755456 00000100:00100000:2.0:1787787253.624505:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484755456 00000100:00100000:2.0:1787787253.624609:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 139 00000100:00100000:2.0:1787787253.624620:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:11378:x1874630484755456:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787787253.624708:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.624724:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.624745:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.624778:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.624793:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 16 pid: 6529 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.624807:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503696128:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787253.625054:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787253.627515:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503696128:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787253.627548:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.627888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.627957:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484755584 00000100:00100000:0.0:1787787253.627964:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484755584 00010000:00010000:0.0:1787787253.628121:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 17 pid: 6529 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.628303:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:2.0:1787787253.628315:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:2392:x1874630484755584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787253.628332:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787253.628339:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 17 pid: 6529 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628357:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 17 pid: 6529 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628380:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a955a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8261 expref: 17 pid: 6529 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628394:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.628400:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 16 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628422:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628429:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628436:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.628748:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787253.628809:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:2392:x1874630484755584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 495us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.628817:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 78 00010000:00010000:1.0:1787787253.628883:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.628891:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.629061:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.629073:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.629081:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.629120:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.629252:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 16 pid: 6527 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787253.629267:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503696256:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787253.630038:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc41126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787253.633321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.633463:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503696256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787253.633491:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.633697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484755712 00000100:00100000:3.0:1787787253.633705:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484755712 00010000:00010000:3.0:1787787253.633757:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 17 pid: 6527 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.633846:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:3.0:1787787253.633855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:2392:x1874630484755712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787253.633870:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787253.633877:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 17 pid: 6527 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.633888:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 17 pid: 6527 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.633910:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e800/0x11620bc3f30a9625 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82a0 expref: 17 pid: 6527 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.633924:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787253.633928:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.633937:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.633944:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.633971:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787253.634157:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.634165:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787253.634264:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787787253.634382:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787787253.634420:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787787253.634522:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503696384:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787787253.634600:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787253.634635:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787253.634643:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503696384 00000100:00100000:2.0:1787787253.634649:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503696384 00000100:00100000:2.0:1787787253.634705:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787787253.634713:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1874630503696384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787787253.634749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:2392:x1874630484755712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 894us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.634758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:2.0:1787787253.634912:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1874630503696384:12345-0@lo:1000:mdt00_001.0 Request processed in 199us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.634919:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787787253.634950:0:6528:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787787253.634957:0:6528:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1787787253.634974:0:6528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9870fc2e5a40, transno 4294967310 00000100:00100000:2.0:1787787253.634995:0:6528:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9870fc2e4f00 x1874630503695488/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787787269 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787253.635006:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503696384:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787787253.635120:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787787253.635212:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503696512:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787787253.635244:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787253.635259:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787253.635807:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503696512 00000100:00100000:0.0:1787787253.635814:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503696512 00000100:00100000:0.0:1787787253.635865:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787787253.635873:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6528:x1874630503696512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787787253.636330:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6528:x1874630503696512:12345-0@lo:1000:mdt00_001.0 Request processed in 456us (1083us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787787253.636338:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787787253.636405:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503696512:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787787253.636442:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636463:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636470:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636476:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.636480:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636489:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636503:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:2.0:1787787253.636764:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787253.636770:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636777:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9672 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636803:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636809:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636827:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636832:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.636835:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636841:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636849:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.636851:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787253.636858:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636869:0:6528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636878:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.636907:0:6528:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.636920:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503696640:192.168.204.31@tcp:105: 00000100:00100000:2.0:1787787253.637090:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787253.640825:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503696640:192.168.204.31@tcp:105: 00010000:00010000:2.0:1787787253.640871:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640882:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a95b5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640916:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640930:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640941:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640950:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640956:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640961:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640967:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.640970:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640977:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.640988:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.640991:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787253.641001:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641007:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a9679 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641017:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641023:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641029:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641035:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787253.641037:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641043:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641051:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.641054:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787253.641056:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.641061:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a966b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.641262:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11378:x1874630484755456:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 16642us (16895us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787787253.641273:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 139 00000020:00080000:2.0:1787787253.641285:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787787253.641560:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787253.641564:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787253.642049:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787787253.642057:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787253.643063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.643784:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484755840 00000100:00100000:2.0:1787787253.643795:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484755840 00000100:00100000:2.0:1787787253.643902:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:2.0:1787787253.643913:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffaca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11377:x1874630484755840:12345-192.168.204.31@tcp:49:lfs.0 00000100:00100000:2.0:1787787253.644052:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffaca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11377:x1874630484755840:12345-192.168.204.31@tcp:49:lfs.0 Request processed in 141us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.644060:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:1.0:1787787253.649115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787253.649289:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484756096 00000100:00100000:3.0:1787787253.649322:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484756096 00000100:00100000:3.0:1787787253.649382:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:3.0:1787787253.649392:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3667450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:11378:x1874630484756096:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787787253.649771:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787253.649803:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1787787253.649837:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.649853:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.649865:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.649873:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.649879:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.649885:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.650000:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787787253.650200:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3667450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:11378:x1874630484756096:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 807us (1096us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787787253.650209:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000020:00080000:0.0:1787787253.650214:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787787253.652335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.652412:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484756352 00000100:00100000:2.0:1787787253.652421:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484756352 00000100:00100000:2.0:1787787253.652479:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 140 00000100:00100000:2.0:1787787253.652488:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffaca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:11377:x1874630484756352:12345-192.168.204.31@tcp:58:lfs.0 00000040:00080000:2.0:1787787253.652643:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787787253.652724:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffaca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:11377:x1874630484756352:12345-192.168.204.31@tcp:58:lfs.0 Request processed in 237us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.652732:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 140 00010000:00010000:1.0:1787787253.654032:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787253.654044:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.654070:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787253.654075:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.654083:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.654100:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:1.0:1787787253.654103:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787787253.654108:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.654114:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9680 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787253.654161:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787253.654163:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787253.654165:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787253.678877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787253.679023:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484756480 00000100:00100000:0.0:1787787253.679033:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484756480 00000100:00100000:0.0:1787787253.679094:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 141 00000100:00100000:0.0:1787787253.679105:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:11380:x1874630484756480:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787253.679174:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787253.679197:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82bc expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679264:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679299:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679310:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679325:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679332:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679337:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679426:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679437:0:13825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679445:0:13825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679487:0:13825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787253.679501:0:13825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 22 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787253.679525:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffacb840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503696768:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787253.679615:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d23790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787253.685979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787253.686075:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484756736 00000100:00100000:1.0:1787787253.686086:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484756736 00000100:00100000:1.0:1787787253.686170:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:1.0:1787787253.686181:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:6161:x1874630484756736:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787787253.686409:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:6161:x1874630484756736:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 229us (440us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787787253.686417:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:2.0:1787787253.686912:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffacb840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503696768:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787253.686939:0:13825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787253.692898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787253.693271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484756864 00000100:00100000:2.0:1787787253.693281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484756864 00010000:00010000:2.0:1787787253.693325:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 24 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787253.693369:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:2.0:1787787253.693395:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:2392:x1874630484756864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787253.693411:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787253.693419:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 24 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.693433:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 24 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.693466:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454e600/0x11620bc3f30a95a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c827d expref: 24 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.693484:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787253.693490:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.693499:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.693517:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787253.693550:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787253.693611:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2392:x1874630484756864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 218us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.693619:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00010000:00010000:3.0:1787787253.693815:0:13825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693825:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787253.693878:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787787253.693890:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787253.693913:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693926:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693936:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693942:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693949:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693956:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.693960:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693967:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693977:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787253.693980:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.693984:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.693990:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a968e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694001:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694019:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694025:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694031:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787253.694034:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694053:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694062:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9870d4cec000) 00010000:00010000:3.0:1787787253.694065:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787253.694068:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694074:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a9695 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694111:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a9687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82bc expref: 23 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694134:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82bc expref: 22 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787253.694199:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787253.694202:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787253.694210:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8ac00, rc 0) 00000100:00100000:3.0:1787787253.694241:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11380:x1874630484756480:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15138us (15376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.694248:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 141 00000001:00080000:2.0:1787787254.261941:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787787254.261964:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:3.0:1787787254.570618:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787254.648990:0:14268:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787254.649000:0:14268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787254.649038:0:14268:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787787254.649044:0:14268:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787787254.697768:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787254.697778:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787254.697820:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787787254.697827:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787254.697974:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503696896:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787254.698074:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3adef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787254.711680:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503696896:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787254.711810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787254.711837:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484756992 00000100:00100000:2.0:1787787254.711843:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484756992 00000100:00100000:2.0:1787787254.711898:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:2.0:1787787254.711907:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11391:x1874630484756992:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787254.711942:0:7753:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787254.712047:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11391:x1874630484756992:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 140us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787254.712054:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:0.0:1787787254.721556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787254.722601:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484757248 00000100:00100000:3.0:1787787254.722615:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484757248 00000100:00100000:3.0:1787787254.722676:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 143 00000100:00100000:3.0:1787787254.722687:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:11391:x1874630484757248:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787254.722707:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787254.722730:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a96a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787254.722853:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a96aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787254.722867:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a96aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787254.722879:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a96aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787254.722890:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787787254.723015:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a96a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82c3 expref: 25 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787254.723036:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a96aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82c3 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787254.723045:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787254.723055:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787254.723060:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7000, rc 0) 00000100:00100000:3.0:1787787254.723130:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:11391:x1874630484757248:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 445us (1588us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787787254.723156:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 143 00000100:00100000:3.0:1787787254.740783:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787254.740824:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484757376 00000100:00100000:3.0:1787787254.740833:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484757376 00000100:00100000:3.0:1787787254.740901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:3.0:1787787254.740913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:2392:x1874630484757376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787254.740929:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787254.740957:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a96aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82c3 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787254.740977:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787254.740982:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787254.741695:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2392:x1874630484757376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 781us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787254.741707:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:1.0:1787787254.741916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787254.745946:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484757632 00000100:00100000:2.0:1787787254.745966:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484757632 00000100:00100000:2.0:1787787254.746037:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 144 00000100:00100000:2.0:1787787254.746048:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:11391:x1874630484757632:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787787254.746157:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746177:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746190:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746362:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746370:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746385:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746391:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787254.746395:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746403:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746417:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:2.0:1787787254.746420:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787254.746424:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787254.746441:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3600/0x11620bc3f30a96b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787254.747475:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:11391:x1874630484757632:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 1420us (5550us total) trans 4294967413 rc 0/0 00000040:00080000:0.0:1787787254.747774:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787254.747781:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787787254.747815:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 144 00000040:00080000:0.0:1787787254.748283:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787787254.748292:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787254.750888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787254.751209:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484757888 00000100:00100000:2.0:1787787254.751219:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484757888 00000100:00100000:2.0:1787787254.751277:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:2.0:1787787254.751288:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:11391:x1874630484757888:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787254.751672:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:11391:x1874630484757888:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 383us (788us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787787254.751682:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:2.0:1787787255.145475:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503697024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787255.145573:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787255.145698:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697024 00000100:00100000:3.0:1787787255.145706:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697024 00000100:00100000:3.0:1787787255.145754:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787787255.145763:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503697024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787255.145797:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787787255.145840:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503697024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787255.145847:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787255.146586:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503697024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787255.594943:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787255.657493:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787255.657521:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503697152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787255.657595:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787255.657984:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787255.657994:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503697408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787255.658039:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787255.658233:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697408 00000100:00100000:1.0:1787787255.658242:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697408 00000100:00100000:1.0:1787787255.658320:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787787255.658330:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503697408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787255.658358:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787787255.658402:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503697408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787255.658409:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787787255.658472:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503697408:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787787255.659907:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787255.660189:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787255.660214:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503697280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787255.660290:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787255.660359:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697152 00000100:00100000:3.0:1787787255.660367:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697152 00000100:00100000:3.0:1787787255.660428:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787787255.660437:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503697152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787255.660477:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787787255.660529:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503697152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787255.660694:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503697920:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.660731:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787255.660751:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503698432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.660778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787255.660795:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787787255.660801:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503697536:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.660829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787255.660849:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503698048:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.660870:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787255.660891:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503698560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.660911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787255.661213:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697920 00000100:00100000:1.0:1787787255.661218:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697920 00000100:00100000:1.0:1787787255.661261:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698432 00000100:00100000:1.0:1787787255.661265:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698432 00000100:00100000:1.0:1787787255.661282:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698048 00000100:00100000:1.0:1787787255.661285:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698048 00000100:00100000:1.0:1787787255.661297:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698560 00000100:00100000:1.0:1787787255.661299:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698560 00000100:00100000:1.0:1787787255.661314:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787787255.661338:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503697920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.661383:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503697920:12345-0@lo:400:kworker.0 Request processed in 48us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787255.661390:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787787255.661407:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787787255.661423:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503698432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.661451:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503698432:12345-0@lo:400:kworker.0 Request processed in 39us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787255.661457:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787787255.661469:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787787255.661475:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503698048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.661501:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503698048:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787255.661506:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787787255.661517:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787787255.661523:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503698560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.661547:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503698560:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787255.661552:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00080000:1.0:1787787255.661592:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41ccb40 x1874630503698048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787255.661748:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787787255.661776:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503697664:0@lo:400:kworker.0 00000100:00100000:3.0:1787787255.661805:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787255.661823:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503698176:0@lo:400:kworker.0 00000100:00100000:3.0:1787787255.661842:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787255.661860:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787787255.661866:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503697792:0@lo:400:kworker.0 00000100:00100000:3.0:1787787255.661887:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787255.661904:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503698304:0@lo:400:kworker.0 00000100:00100000:3.0:1787787255.661926:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787255.662119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697536 00000100:00100000:0.0:1787787255.662124:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697536 00000100:00100000:0.0:1787787255.662178:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787787255.662185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503697536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787255.662233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503697536:12345-0@lo:400:kworker.0 Request processed in 49us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787255.662239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787787255.662293:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503697152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787255.662340:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697664 00000100:00100000:0.0:1787787255.662344:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697664 00000100:00100000:0.0:1787787255.662361:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697792 00000100:00100000:0.0:1787787255.662363:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697792 00000100:00100000:0.0:1787787255.662375:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787787255.662381:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503697664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787255.662428:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503697664:12345-0@lo:400:kworker.0 Request processed in 46us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787255.662434:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787787255.662447:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787787255.662453:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503697792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787255.662480:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503697792:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787255.662486:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787787255.663857:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698176 00000100:00100000:3.0:1787787255.663869:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698176 00000100:00100000:3.0:1787787255.663918:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698304 00000100:00100000:3.0:1787787255.663922:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698304 00000100:00100000:1.0:1787787255.664679:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503698048:0@lo:400:kworker.0 00010000:00080000:1.0:1787787255.664787:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e70c0 x1874630503698560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787255.664822:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503698560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.664839:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503697920:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.664851:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503698432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.664881:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503697536:0@lo:400:kworker.0 00000100:00100000:2.0:1787787255.665079:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503697280 00000100:00100000:2.0:1787787255.665085:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503697280 00000100:00100000:2.0:1787787255.665130:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787787255.665162:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874630503697280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787255.665185:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787787255.665253:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874630503697280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787255.665261:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787787255.665446:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503697792:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.665463:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503697664:0@lo:400:kworker.0 00000100:00100000:1.0:1787787255.665479:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503697280:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787787255.665525:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787255.665530:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787255.665534:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787255.665536:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787255.666130:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787787255.666163:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503698176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787255.666235:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503698176:12345-0@lo:400:kworker.0 Request processed in 97us (4391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787255.666242:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787787255.666256:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787787255.666263:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503698304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787255.666292:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503698304:12345-0@lo:400:kworker.0 Request processed in 30us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787255.666298:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787787255.676170:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787787255.676184:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1787787255.676213:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9870ffac8f00, transno 4294967302 00000004:00080000:2.0:1787787255.676231:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1787787255.676243:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff986fc4281a40, transno 4294967305 00000100:00100000:2.0:1787787255.676257:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503698304:0@lo:400:kworker.0 00000100:00100000:2.0:1787787255.676275:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503698176:0@lo:400:kworker.0 00000040:00080000:0.0:1787787256.615473:0:14319:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787256.615484:0:14319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787256.615941:0:14319:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787787256.615948:0:14319:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787787256.620003:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787256.805705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787256.805773:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758144 00000100:00100000:0.0:1787787256.805787:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758144 00000100:00100000:0.0:1787787256.805915:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 145 00000100:00100000:0.0:1787787256.805925:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:11412:x1874630484758144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787256.805967:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787256.805991:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a96bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82ca expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.806100:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a96c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.806115:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a96c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.806126:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a96c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787256.806184:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787787256.806295:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a96bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ca expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.806313:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a96c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ca expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.806322:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:0.0:1787787256.806325:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787787256.806328:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a200, rc 0) 00000100:00100000:0.0:1787787256.806380:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:11412:x1874630484758144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 458us (686us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787787256.806387:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 145 00000100:00080000:1.0:1787787256.806661:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787256.809571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787256.809662:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758272 00000100:00100000:0.0:1787787256.809673:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758272 00000100:00100000:0.0:1787787256.809759:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 146 00000100:00100000:0.0:1787787256.809784:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:11412:x1874630484758272:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:0.0:1787787256.809853:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809870:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809882:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809919:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809927:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809934:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809940:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787256.809944:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809952:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809963:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:0.0:1787787256.809966:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787256.809971:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.809978:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a600/0x11620bc3f30a96d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787256.810059:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:11412:x1874630484758272:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 277us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787256.810067:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 146 00000100:00100000:3.0:1787787256.906273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787256.906384:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758400 00000100:00100000:0.0:1787787256.906404:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758400 00000100:00100000:0.0:1787787256.906488:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:0.0:1787787256.906509:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484758400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1787787256.906529:0:13816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787256.906549:0:13816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3cb08c9/0x11620bc3f30a96db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82d1 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787256.906576:0:13816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f77f5, atime: 0x6a8f77f4, ctime: 0x6a8f77f5, blocks: 0x8 00010000:00010000:0.0:1787787256.906596:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1787787256.906612:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787256.906622:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3cb08c9/0x11620bc3f30a96db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d1 expref: 7 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.906643:0:13816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3cb08c9/0x11620bc3f30a96db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d1 expref: 7 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.906658:0:13816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a600, rc 0) 00000100:00080000:1.0:1787787256.906933:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787256.907067:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2393:x1874630484758400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 568us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787256.907074:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:3.0:1787787256.938095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787256.941044:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758528 00000100:00100000:1.0:1787787256.941059:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758528 00002000:00100000:1.0:1787787256.941125:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff986fc42812c0 x1874630484758528/t0(0) o3->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:117/0 lens 488/0 e 0 to 0 dl 1787787267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787787256.941137:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc42812c0 with x1874630484758528 ext(0->4095) 00002000:00010000:1.0:1787787256.941185:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc42812c0 00000100:00100000:1.0:1787787256.941264:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:1.0:1787787256.941276:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484758528:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1787787256.941518:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484758528:12345-192.168.204.31@tcp:3:cat.0 Request processed in 244us (3433us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787787256.941531:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00002000:00100000:1.0:1787787256.941537:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff986fc42812c0 x1874630484758528/t0(0) o3->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:117/0 lens 488/4536 e 0 to 0 dl 1787787267 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787787256.941547:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc42812c0 with x1874630484758528 ext(0->4095) 00002000:00010000:1.0:1787787256.941550:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc42812c0 00000100:00100000:3.0:1787787257.518433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518519:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787257.518913:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759168 00000100:00100000:3.0:1787787257.518923:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759168 00000100:00100000:3.0:1787787257.518970:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759040 00000100:00100000:3.0:1787787257.518973:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759040 00000100:00100000:3.0:1787787257.519005:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:3.0:1787787257.519014:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484759168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787257.519099:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484759168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787257.519127:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:3.0:1787787257.519191:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:3.0:1787787257.519198:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484759040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787257.519223:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484759040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787257.519229:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:3.0:1787787257.519251:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758912 00000100:00100000:3.0:1787787257.519254:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758912 00000100:00100000:3.0:1787787257.519278:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759424 00000100:00100000:3.0:1787787257.519281:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759424 00000100:00100000:3.0:1787787257.519295:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758784 00000100:00100000:3.0:1787787257.519297:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758784 00000100:00100000:3.0:1787787257.519308:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759296 00000100:00100000:3.0:1787787257.519311:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759296 00000100:00100000:3.0:1787787257.519325:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 294 00000100:00100000:3.0:1787787257.519332:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484758912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787257.519358:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2394:x1874630484758912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787257.519364:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 294 00000100:00100000:3.0:1787787257.519374:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 295 00000100:00100000:3.0:1787787257.519392:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484759424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787257.519417:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484759424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787257.519423:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 295 00000100:00100000:3.0:1787787257.519588:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 296 00000100:00100000:3.0:1787787257.519747:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:2394:x1874630484758784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787257.519776:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:2394:x1874630484758784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787257.519782:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 296 00000100:00100000:3.0:1787787257.519794:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 297 00000100:00100000:3.0:1787787257.519800:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484759296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787257.519821:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2394:x1874630484759296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787257.519827:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 297 00000100:00100000:2.0:1787787257.519870:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484758656 00000100:00100000:2.0:1787787257.519875:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484758656 00000100:00100000:2.0:1787787257.519908:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 381 00000100:00100000:2.0:1787787257.519915:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2394:x1874630484758656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787257.519941:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2394:x1874630484758656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787257.519956:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 381 00000100:00080000:1.0:1787787257.520104:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787257.520109:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787257.520113:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787257.644159:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787258.219822:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503698688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787258.219822:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503698816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787258.225426:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.225550:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787258.225650:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698688 00000100:00100000:0.0:1787787258.225662:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698688 00000100:00100000:2.0:1787787258.226242:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698816 00000100:00100000:2.0:1787787258.226249:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698816 00000100:00100000:0.0:1787787258.226556:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787787258.226568:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503698688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787258.226608:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787258.226671:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503698688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.226678:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787787258.226730:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503698688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787258.232043:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787258.245682:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787787258.245700:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503698816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787258.245728:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787258.245840:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503698816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (20289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.245848:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787787258.245926:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503698816:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787787258.666749:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787259.689806:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787787259.761411:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787787259.761426:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787787259.770993:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1787787259.771040:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870f58520c0 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:3.0:1787787259.771041:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787787259.771045:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3759900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870f5852840 00000020:00080000:2.0:1787787259.771049:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3759800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870d0e18400 00010000:00010000:3.0:1787787259.771053:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787259.771061:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787787259.771065:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1787787259.771091:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787259.771095:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787259.771103:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787259.771121:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff986fc3a1d700) 00010000:00010000:3.0:1787787259.771124:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787259.771131:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787259.771156:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9656 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787787259.771960:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787787259.772088:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:1.0:1787787260.202055:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787260.270627:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787260.270650:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503698944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787260.270769:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787260.270834:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503698944 00000100:00100000:2.0:1787787260.270842:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503698944 00000100:00100000:2.0:1787787260.270888:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787787260.270897:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503698944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787260.270929:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787260.270973:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503698944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.270980:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787787260.271026:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503698944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787260.713371:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787260.780177:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787260.780201:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503699072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787260.780306:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787260.780585:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699072 00000100:00100000:0.0:1787787260.780592:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699072 00000100:00100000:0.0:1787787260.780647:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787787260.780657:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503699072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787260.780700:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787787260.780774:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503699072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787260.780781:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787787260.780802:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787260.780828:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787787260.780833:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9870fc2e4f00, transno 4294967311 00000004:00080000:0.0:1787787260.780844:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1787787260.780869:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503699072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787260.781014:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503699200:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.781048:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787260.781082:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699200 00000100:00100000:0.0:1787787260.781086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699200 00000100:00100000:0.0:1787787260.781109:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787787260.781116:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503699200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.781183:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503699200:12345-0@lo:400:kworker.0 Request processed in 67us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787260.781189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787787260.781221:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503699200:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.781248:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787260.781254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503699328:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.781279:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787260.781335:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503699456:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.781377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787260.781615:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699328 00000100:00100000:3.0:1787787260.781620:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699328 00000100:00100000:3.0:1787787260.781650:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787787260.781657:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503699328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787260.781698:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503699328:12345-0@lo:400:kworker.0 Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787260.781704:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787787260.781744:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503699328:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.781993:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787260.782011:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503699712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787260.782042:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787260.782076:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699456 00000100:00100000:2.0:1787787260.782080:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699456 00000100:00100000:2.0:1787787260.782107:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787787260.782113:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503699456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.782173:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503699456:12345-0@lo:400:kworker.0 Request processed in 60us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.782179:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787787260.782201:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699712 00000100:00100000:2.0:1787787260.782205:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699712 00000100:00100000:2.0:1787787260.782236:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787787260.782243:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503699712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787787260.782255:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787787260.782284:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503699712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.782290:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787787260.782306:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787260.782336:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503699712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787260.782377:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503699840:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.782398:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787260.782434:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699840 00000100:00100000:2.0:1787787260.782438:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699840 00000100:00100000:2.0:1787787260.782463:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787787260.782468:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503699840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.782499:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503699840:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.782511:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1787787260.782526:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787260.782543:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503699840:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.782581:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503700224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.782606:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787260.782629:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700224 00000100:00100000:2.0:1787787260.782632:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700224 00000100:00100000:2.0:1787787260.782656:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787787260.782662:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503700224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.782692:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503700224:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.782697:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787787260.782708:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787260.782888:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787260.782899:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503699968:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.782924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787260.782941:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503699584:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.782959:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787260.782980:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503699456:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.782990:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787260.782995:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503700096:0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.783014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787260.783047:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699968 00000100:00100000:0.0:1787787260.783051:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699968 00000100:00100000:0.0:1787787260.783075:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787787260.783082:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787260.783113:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503699968:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787260.783119:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787787260.783211:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503700224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.783246:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503700352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.783270:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787260.783293:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503699584 00000100:00100000:2.0:1787787260.783295:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503699584 00000100:00100000:2.0:1787787260.783327:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700352 00000100:00100000:2.0:1787787260.783330:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700352 00000100:00100000:2.0:1787787260.783348:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787787260.783354:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503699584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.783381:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503699584:12345-0@lo:400:kworker.0 Request processed in 27us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.783386:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787787260.783402:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787787260.783408:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503700352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787787260.783674:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787260.783679:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787260.783693:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503700480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787260.783734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787787260.783762:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a061c0 x1874630503699968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787260.783773:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503699968:0@lo:400:kworker.0 00000100:00100000:1.0:1787787260.783782:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503699584:0@lo:400:kworker.0 00000100:00100000:1.0:1787787260.783805:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700480 00000100:00100000:1.0:1787787260.783808:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700480 00000100:00100000:1.0:1787787260.783832:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787787260.783838:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503700480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787260.783870:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787787260.783944:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503700480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787260.783951:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787787260.783981:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503700480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787260.784019:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787260.784026:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503700608:0@lo:400:kworker.0 00000100:00100000:1.0:1787787260.784047:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787260.784069:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700608 00000100:00100000:1.0:1787787260.784072:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700608 00000100:00100000:1.0:1787787260.784099:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787787260.784106:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503700608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787260.784170:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503700608:12345-0@lo:400:kworker.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787260.784177:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:1.0:1787787260.784192:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787787260.784206:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e6580 x1874630503700608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787260.784215:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503700608:0@lo:400:kworker.0 00000100:00100000:3.0:1787787260.784597:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700096 00000100:00100000:3.0:1787787260.784602:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700096 00000100:00100000:3.0:1787787260.784651:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787787260.784659:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503700096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787260.784722:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503700096:12345-0@lo:400:kworker.0 Request processed in 53us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787260.784730:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787787260.784767:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503700096:0@lo:400:kworker.0 00000100:00100000:2.0:1787787260.784931:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503700352:12345-0@lo:400:kworker.0 Request processed in 1521us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787260.784938:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787787260.785673:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503700352:0@lo:400:kworker.0 00000100:00080000:1.0:1787787260.785942:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787787260.905365:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787260.905376:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787260.905434:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787787260.905443:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787787261.738010:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787262.560418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787262.560593:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759552 00000100:00100000:1.0:1787787262.560604:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759552 00000100:00100000:1.0:1787787262.560708:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 147 00000100:00100000:1.0:1787787262.560718:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11064:x1874630484759552:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787787262.560847:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11064:x1874630484759552:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 Request processed in 130us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787262.560856:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 147 00000100:00080000:2.0:1787787262.561656:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787262.570725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787262.570867:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759680 00000100:00100000:0.0:1787787262.570878:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759680 00000100:00100000:0.0:1787787262.570962:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00100000:0.0:1787787262.570972:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:11064:x1874630484759680:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787787262.571076:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:11064:x1874630484759680:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.571084:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00080000:2.0:1787787262.571158:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787262.575609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787262.575708:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484759936 00000100:00100000:1.0:1787787262.575718:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484759936 00000100:00100000:1.0:1787787262.575777:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:1.0:1787787262.575787:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:11064:x1874630484759936:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787787262.576027:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:11064:x1874630484759936:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 240us (428us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787787262.576036:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:3.0:1787787262.640255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787262.640317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787262.640366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787262.640566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787262.640602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787262.640631:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760320 00000100:00100000:3.0:1787787262.640640:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760320 00000100:00100000:3.0:1787787262.640699:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760192 00000100:00100000:3.0:1787787262.640703:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760192 00000100:00100000:3.0:1787787262.640730:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:3.0:1787787262.640741:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484760320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787262.640813:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484760320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787262.640821:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:3.0:1787787262.640837:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:3.0:1787787262.640845:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484760192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787262.640870:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484760192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.640887:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760576 00000100:00100000:3.0:1787787262.640892:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:0.0:1787787262.640894:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760576 00000100:00080000:3.0:1787787262.640912:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787262.640918:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787262.640921:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787262.640937:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760448 00000100:00100000:0.0:1787787262.640941:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760448 00000100:00100000:0.0:1787787262.640974:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 304 00000100:00100000:0.0:1787787262.640983:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484760576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787262.641017:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484760576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.641024:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 304 00000100:00100000:0.0:1787787262.641037:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 305 00000100:00100000:0.0:1787787262.641044:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484760448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787262.641077:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484760448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.641090:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 305 00000100:00080000:0.0:1787787262.641109:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787262.642405:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760064 00000100:00100000:2.0:1787787262.642417:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760064 00000100:00100000:0.0:1787787262.642566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 383 00000100:00100000:0.0:1787787262.642578:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484760064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787262.642673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484760064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.642689:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 383 00010000:00010000:3.0:1787787262.761725:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787262.901211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787262.903444:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760704 00000100:00100000:0.0:1787787262.903458:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760704 00000100:00100000:0.0:1787787262.903529:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 149 00000100:00100000:0.0:1787787262.903541:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:11870:x1874630484760704:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:0.0:1787787262.903561:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787262.903584:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a96e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787262.903645:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787262.903659:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787262.903673:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787262.903720:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787262.903737:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787262.903781:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787262.903805:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a96e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787262.903822:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787262.903830:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:0.0:1787787262.903844:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787262.903847:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a800, rc 0) 00000100:00100000:0.0:1787787262.903920:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+6:11870:x1874630484760704:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 380us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.903928:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 149 00000100:00100000:2.0:1787787263.337790:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ff9583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503700864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787263.337831:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503700736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787263.337864:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787263.337984:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700864 00000100:00100000:3.0:1787787263.337992:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700864 00000100:00100000:1.0:1787787263.338040:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787263.340263:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700736 00000100:00100000:3.0:1787787263.340290:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700736 00000100:00100000:2.0:1787787263.340290:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787787263.340313:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503700864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787263.340351:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787263.340412:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787787263.340425:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503700736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787263.340446:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787263.340451:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503700864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.340460:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1787787263.340490:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787263.340504:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503700736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.340512:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787787263.340544:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ff9583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503700864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787263.340667:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503700736:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787787263.785860:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787264.809402:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787265.385787:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503700992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787265.385865:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787265.386080:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503700992 00000100:00100000:2.0:1787787265.386090:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503700992 00000100:00100000:2.0:1787787265.386163:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787787265.386173:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503700992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787265.386211:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787265.386285:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503700992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787265.386292:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787787265.386492:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503700992:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787265.834526:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787265.897498:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503701120:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897570:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897615:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503701632:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897662:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503702144:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897683:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897700:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503702656:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897736:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787787265.897741:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503701504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897779:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503702016:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897796:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787265.897805:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503701376:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897810:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503702528:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897842:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787265.897856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897877:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702144 00000100:00100000:1.0:1787787265.897882:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503701888:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897885:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702144 00000100:00100000:1.0:1787787265.897908:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787265.897930:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503702400:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.897941:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702656 00000100:00100000:3.0:1787787265.897946:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702656 00000100:00100000:1.0:1787787265.897956:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.897962:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702016 00000100:00100000:3.0:1787787265.897966:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702016 00000100:00100000:1.0:1787787265.897981:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787787265.897983:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702528 00000100:00100000:3.0:1787787265.897987:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702528 00000100:00100000:1.0:1787787265.897991:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898007:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787787265.898018:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.898020:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503702144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898065:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503701760:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898094:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787265.898113:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503702272:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898136:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787265.898186:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701504 00000100:00100000:3.0:1787787265.898189:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff9583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503702144:12345-0@lo:400:kworker.0 Request processed in 172us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787265.898191:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701504 00000100:00100000:3.0:1787787265.898201:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787787265.898235:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787787265.898240:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701888 00000100:00100000:3.0:1787787265.898245:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503702656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898245:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701888 00000100:00100000:1.0:1787787265.898265:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702400 00000100:00100000:1.0:1787787265.898269:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702400 00000100:00100000:1.0:1787787265.898285:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701248 00000100:00100000:3.0:1787787265.898287:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503702656:12345-0@lo:400:kworker.0 Request processed in 44us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787265.898289:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701248 00000100:00100000:1.0:1787787265.898301:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701760 00000100:00100000:3.0:1787787265.898303:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787787265.898305:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701760 00000100:00100000:3.0:1787787265.898323:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787787265.898326:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702272 00000100:00100000:1.0:1787787265.898330:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702272 00000100:00100000:3.0:1787787265.898334:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503702016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898350:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787787265.898358:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503701504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898371:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503702016:12345-0@lo:400:kworker.0 Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898378:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787787265.898397:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787787265.898401:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503701504:12345-0@lo:400:kworker.0 Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898408:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503702528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898438:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503702528:12345-0@lo:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898443:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787787265.898464:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787787265.898471:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503701888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898502:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503701888:12345-0@lo:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898507:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787787265.898518:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787787265.898523:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503702400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898546:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503702400:12345-0@lo:400:kworker.0 Request processed in 23us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898551:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787787265.898560:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787787265.898564:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503701248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898588:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503701248:12345-0@lo:400:kworker.0 Request processed in 24us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898600:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787787265.898612:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787787265.898617:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503701760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898641:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503701760:12345-0@lo:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898646:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787787265.898655:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787787265.898660:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503702272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898680:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503702272:12345-0@lo:400:kworker.0 Request processed in 21us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.898685:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787787265.898719:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787787265.898729:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503701504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787265.898743:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503702016:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898755:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701632 00000100:00100000:3.0:1787787265.898758:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503702528:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898761:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701632 00000100:00100000:3.0:1787787265.898772:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503702144:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898783:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701376 00000100:00100000:3.0:1787787265.898788:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503702656:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898788:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701376 00000100:00100000:1.0:1787787265.898806:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787787265.898814:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503701632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898859:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ff95a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503701632:12345-0@lo:400:kworker.0 Request processed in 46us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787265.898875:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787787265.898879:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503701632:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787787265.898900:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503701376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898928:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503701376:12345-0@lo:400:kworker.0 Request processed in 31us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787265.898933:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787787265.898956:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503701248:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898965:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503701760:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898974:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503702272:0@lo:400:kworker.0 00000100:00100000:1.0:1787787265.898982:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503701376:0@lo:400:kworker.0 00010000:00080000:1.0:1787787265.898993:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41cc780 x1874630503701888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787265.899002:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503701888:0@lo:400:kworker.0 00010000:00080000:1.0:1787787265.899010:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41ccf00 x1874630503702400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787265.899017:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503702400:0@lo:400:kworker.0 00000100:00100000:2.0:1787787265.899230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503701120 00000100:00100000:2.0:1787787265.899241:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503701120 00000100:00100000:2.0:1787787265.899271:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787787265.899277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503701120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787265.899314:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503701120:12345-0@lo:400:kworker.0 Request processed in 38us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787265.899320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:2.0:1787787265.899347:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787265.899352:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787265.899355:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787265.899357:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787265.899388:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c1325e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503702784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787265.899926:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787265.899981:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503701120:0@lo:400:kworker.0 00000100:00100000:2.0:1787787265.900025:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702784 00000100:00100000:2.0:1787787265.900029:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702784 00000100:00100000:3.0:1787787265.900308:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787265.900319:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503702912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787265.900355:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787265.900386:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503702912 00000100:00100000:3.0:1787787265.900389:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503702912 00000100:00100000:3.0:1787787265.900431:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787787265.900439:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503702912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787265.900466:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787787265.900504:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503702912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787265.900511:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787787265.900545:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503702912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787265.900600:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787787265.900606:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1325680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503702784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787265.900630:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787787265.900863:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503703040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787265.901611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787265.901677:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503703040 00000100:00100000:1.0:1787787265.901683:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503703040 00000100:00100000:1.0:1787787265.901717:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787787265.901726:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503703040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787265.901753:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787787265.901796:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503703040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787265.901802:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787787265.901840:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503703040:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787787265.906188:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787787265.906204:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787787265.906236:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787787265.906249:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787787265.907234:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1325680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503702784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6604us (7287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787265.907248:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787265.914395:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c1325e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503702784:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787787266.636934:0:14517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:34:25 (1787787265) 00010000:00010000:1.0:1787787266.858125:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787267.769248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787267.769375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787267.769413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787267.769449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787267.769466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787267.769483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787267.769637:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761088 00000100:00100000:0.0:1787787267.769647:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761088 00000100:00100000:0.0:1787787267.769706:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761600 00000100:00100000:0.0:1787787267.769710:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761600 00000100:00100000:0.0:1787787267.769727:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760960 00000100:00100000:0.0:1787787267.769730:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760960 00000100:00100000:0.0:1787787267.769753:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 312 00000100:00100000:0.0:1787787267.769763:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484761088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787267.769838:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484761088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787267.769855:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 312 00000100:00100000:0.0:1787787267.769874:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 313 00000100:00100000:0.0:1787787267.769881:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484761600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787267.769908:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484761600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787267.769914:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 313 00000100:00100000:0.0:1787787267.769926:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 314 00000100:00100000:0.0:1787787267.769933:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:2392:x1874630484760960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787267.769961:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:2392:x1874630484760960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787267.769966:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 314 00000100:00080000:0.0:1787787267.769984:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787267.769988:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787267.771746:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761344 00000100:00100000:0.0:1787787267.771760:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761344 00000100:00100000:0.0:1787787267.771813:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761216 00000100:00100000:0.0:1787787267.771816:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761216 00000100:00100000:0.0:1787787267.771844:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:0.0:1787787267.771854:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484761344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787267.771915:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484761344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 63us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787267.772238:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:0.0:1787787267.772256:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00100000:0.0:1787787267.772263:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484761216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787267.772305:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484761216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787267.772312:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00080000:0.0:1787787267.772374:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787267.772378:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787267.772959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787267.773231:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761472 00000100:00100000:1.0:1787787267.773240:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761472 00000100:00100000:1.0:1787787267.773306:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 315 00000100:00100000:1.0:1787787267.773316:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484761472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787267.773380:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2392:x1874630484761472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.773388:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 315 00000100:00080000:2.0:1787787267.773654:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787267.774904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484760832 00000100:00100000:3.0:1787787267.774916:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484760832 00000100:00100000:3.0:1787787267.775373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00100000:3.0:1787787267.775384:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484760832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787267.775657:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484760832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 274us (6530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787267.775665:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 385 00010000:00010000:3.0:1787787267.881508:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787267.982650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787267.982785:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761856 00000100:00100000:1.0:1787787267.982795:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761856 00000100:00100000:1.0:1787787267.982864:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 150 00000100:00100000:1.0:1787787267.982875:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:12137:x1874630484761856:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787267.982896:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787267.982917:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a96f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82df expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.982992:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983007:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983033:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983092:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983101:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983108:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983280:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9705 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983290:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983298:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787267.983307:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787787267.983385:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983394:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983401:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983407:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787267.983416:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983424:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983435:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff986fc29b7800) 00010000:00010000:1.0:1787787267.983438:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787267.983442:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983448:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a96f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983462:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983468:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983473:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983479:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787267.983482:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983487:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983494:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9870d0e3eb00) 00010000:00010000:1.0:1787787267.983496:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787267.983504:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983510:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a96fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983851:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a96f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82df expref: 16 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983867:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9705 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82df expref: 15 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787267.983875:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:1.0:1787787267.983878:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787267.983880:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:1.0:1787787267.983954:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:12137:x1874630484761856:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 1080us (1313us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787787267.983962:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 150 00000100:00100000:0.0:1787787267.989025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787267.989261:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787267.989373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484762112 00000100:00100000:2.0:1787787267.989389:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484762112 00000100:00100000:2.0:1787787267.989476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:2.0:1787787267.989488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:2391:x1874630484762112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787267.989504:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787267.989544:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9705 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82df expref: 15 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787267.989568:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:2.0:1787787267.989574:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787267.989646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:2391:x1874630484762112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 160us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787267.989654:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:1.0:1787787267.990693:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484761984 00000100:00100000:1.0:1787787267.990709:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484761984 00000100:00100000:1.0:1787787267.990908:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 151 00000100:00100000:1.0:1787787267.990921:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:12137:x1874630484761984:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787787267.991074:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:12137:x1874630484761984:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 156us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.991082:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 151 00000100:00100000:0.0:1787787268.005407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787268.005535:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484762240 00000100:00100000:1.0:1787787268.005547:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484762240 00000100:00100000:1.0:1787787268.005621:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 152 00000100:00100000:1.0:1787787268.005653:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:12137:x1874630484762240:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787787268.005937:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:12137:x1874630484762240:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 286us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787268.005946:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 152 00000040:00080000:0.0:1787787268.073445:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787268.073456:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787268.073979:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787787268.073995:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787787268.395699:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787268.457940:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787268.458003:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503703168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787268.458074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787268.458372:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503703296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787268.458404:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787268.458447:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503703168 00000100:00100000:3.0:1787787268.458454:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503703168 00000100:00100000:3.0:1787787268.458520:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503703296 00000100:00100000:3.0:1787787268.458523:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503703296 00000100:00100000:3.0:1787787268.458542:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787787268.458549:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503703168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787268.458587:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787268.458632:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503703168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787268.458639:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787787268.458656:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787787268.458663:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503703296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787268.458673:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787268.458701:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503703296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787268.458706:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787787268.458755:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503703296:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787787268.458860:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787268.458964:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503703168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787787268.912973:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787269.851110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787269.851201:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484762368 00000100:00100000:1.0:1787787269.851211:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484762368 00000100:00100000:1.0:1787787269.851287:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 153 00000100:00100000:1.0:1787787269.851297:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:12179:x1874630484762368:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787269.851317:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787269.851392:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82e6 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851460:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851476:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851489:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851503:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851510:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851517:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851566:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851573:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851579:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851585:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787269.851589:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851595:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851607:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:1.0:1787787269.851610:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787269.851615:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851621:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a971a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851633:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851638:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851644:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851671:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787269.851801:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851810:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851819:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9870d0e3eb00) 00010000:00010000:1.0:1787787269.851822:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787269.851825:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851831:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9721 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851865:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9713 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82e6 expref: 15 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851876:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:1.0:1787787269.851879:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787269.851883:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82e6 expref: 15 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.851894:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:1.0:1787787269.851962:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:12179:x1874630484762368:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 666us (863us total) trans 0 rc 301/301 00000100:00100000:1.0:1787787269.851970:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 153 00000100:00080000:2.0:1787787269.852091:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787269.866213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787269.866895:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484762624 00000100:00100000:1.0:1787787269.866911:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484762624 00000100:00100000:1.0:1787787269.866971:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 154 00000100:00100000:1.0:1787787269.866981:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:12179:x1874630484762624:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1787787269.867038:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787269.867065:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9067 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c810a expref: 14 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.867084:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:1.0:1787787269.867089:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787269.867170:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.867186:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 5 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.867196:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.867230:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 5 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.867245:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 5 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787269.867259:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503703424:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787269.867340:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787269.870785:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503703424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787269.870879:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787269.870931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787269.871093:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484762752 00000100:00100000:3.0:1787787269.871101:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484762752 00000100:00080000:2.0:1787787269.871279:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787787269.871307:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 6 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787269.871416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:3.0:1787787269.871427:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2391:x1874630484762752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787269.871443:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787269.871450:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 6 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787269.871463:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 6 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787269.871487:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a96e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d8 expref: 6 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787269.871510:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:3.0:1787787269.871515:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787269.871523:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787269.871530:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787269.871564:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787269.871622:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.871631:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.871652:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.871682:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.871702:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872325:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872337:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872345:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787269.872435:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484762752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1007us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787269.872445:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 81 00000004:00010000:0.0:1787787269.872830:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f375f407 reply state 00000000e59b8ab9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872843:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872850:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787269.872853:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787269.872857:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787787269.872863:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787787269.872871:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872877:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872883:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872888:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787269.872901:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872907:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872915:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a19e00) 00010000:00010000:0.0:1787787269.872918:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787269.872921:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872926:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9728 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787269.872942:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f375f407 reply state 00000000e59b8ab9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872950:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787269.872955:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9870d4cec200) 00010000:00010000:0.0:1787787269.872958:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787269.872960:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787787269.873058:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:12179:x1874630484762624:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 6078us (6852us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787787269.873066:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 154 00010000:00010000:1.0:1787787269.931463:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787269.952068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787269.952133:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484762880 00000100:00100000:1.0:1787787269.952242:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484762880 00000100:00100000:1.0:1787787269.952373:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 155 00000100:00100000:1.0:1787787269.952384:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+15:12187:x1874630484762880:12345-192.168.204.31@tcp:101:lctl.0 00010000:00010000:1.0:1787787269.952408:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787269.952433:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a973d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.952499:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.952514:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.952527:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787269.952575:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787787269.952579:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787269.952601:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.952627:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a973d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ed expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.952646:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ed expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787269.952655:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:1.0:1787787269.953237:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787269.953245:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031c00, rc 0) 00000100:00100000:1.0:1787787269.953791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:12187:x1874630484762880:12345-192.168.204.31@tcp:101:lctl.0 Request processed in 1405us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787269.953800:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 155 00000100:00100000:3.0:1787787270.025689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.025968:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484763008 00000100:00100000:2.0:1787787270.025979:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484763008 00000100:00100000:1.0:1787787270.026185:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 156 00000100:00100000:1.0:1787787270.026210:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+16:12193:x1874630484763008:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787270.026229:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787270.026259:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a974b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82f4 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026323:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026336:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026348:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026359:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026366:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026373:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026465:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9760 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026474:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026494:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787270.026529:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787787270.026532:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787270.026552:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026564:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026569:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026576:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026581:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787270.026585:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026592:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026603:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:1.0:1787787270.026606:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787270.026609:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026615:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026638:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026644:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026649:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026654:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787270.026657:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026663:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026671:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9870d4cec200) 00010000:00010000:1.0:1787787270.026673:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787270.026677:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026683:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026710:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a974b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82f4 expref: 18 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026722:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9760 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82f4 expref: 17 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.026753:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:1.0:1787787270.026755:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787787270.026758:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:1.0:1787787270.026816:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:12193:x1874630484763008:12345-192.168.204.31@tcp:101:bash.0 Request processed in 622us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787270.027954:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 156 00000100:00100000:2.0:1787787270.031909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.032024:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484763264 00000100:00100000:3.0:1787787270.032035:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484763264 00000100:00100000:3.0:1787787270.032258:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 157 00000100:00100000:3.0:1787787270.032269:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+17:12193:x1874630484763264:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787270.032290:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787270.032311:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9767 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c82fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.032980:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.033908:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.033944:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.033985:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.033995:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.034013:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787787270.034614:0:6528:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787787270.035600:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035617:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035628:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035662:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035669:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035676:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035681:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787270.035696:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035704:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035717:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787270.035721:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787270.035725:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035732:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a976e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787270.035760:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054a6b7bb reply state 00000000a936cec4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035771:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035777:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:3.0:1787787270.035779:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787270.035781:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787787270.035828:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9767 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035845:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.035852:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:3.0:1787787270.035855:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787270.035864:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7a00, rc 0) 00000100:00100000:3.0:1787787270.035928:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:12193:x1874630484763264:12345-192.168.204.31@tcp:101:bash.0 Request processed in 3660us (4030us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787787270.035937:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 157 00000100:00100000:0.0:1787787270.042427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.042564:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484763392 00000100:00100000:3.0:1787787270.042573:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484763392 00000100:00100000:3.0:1787787270.042644:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:3.0:1787787270.042655:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2393:x1874630484763392:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787270.042673:0:9030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787270.042696:0:9030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8302 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787270.042722:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787270.042740:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787787270.042745:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787270.042755:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 6 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.042775:0:9030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 6 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.042789:0:9030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c1391000, rc 0) 00000100:00100000:3.0:1787787270.042872:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484763392:12345-192.168.204.31@tcp:101:bash.0 Request processed in 219us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.042879:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00080000:2.0:1787787270.043072:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787270.053899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.053994:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484763520 00000100:00100000:3.0:1787787270.054013:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484763520 00000100:00100000:3.0:1787787270.054086:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:3.0:1787787270.054095:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:12193:x1874630484763520:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787270.054113:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787270.054133:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8309 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.054209:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.054219:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787270.054224:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787270.054230:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.056210:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.056237:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787270.056255:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8441:1874630503703552:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787270.056362:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787270.061424:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8441:1874630503703552:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787270.061460:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.061500:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:1.0:1787787270.061613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.061717:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:12193:x1874630484763520:12345-192.168.204.31@tcp:101:bash.0 Request processed in 7622us (7828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.061727:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:2.0:1787787270.062687:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484763648 00000100:00100000:2.0:1787787270.062698:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484763648 00010000:00010000:2.0:1787787270.062736:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787270.062778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:2.0:1787787270.062787:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484763648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787270.062802:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787270.062823:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.062838:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.062861:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc1f1809/0x11620bc3f30a978a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8302 expref: 7 pid: 9030 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.062880:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787270.062885:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787270.062893:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.062902:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.062937:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787270.062964:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d96452c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6514:1874630503703680:192.168.204.31@tcp:105: 00000100:00100000:2.0:1787787270.063036:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cacc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787270.073411:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d96452c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6514:1874630503703680:192.168.204.31@tcp:105: 00010000:00010000:2.0:1787787270.073444:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787270.073633:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2391:x1874630484763648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10845us (12981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787270.073644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:0.0:1787787270.080348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.081349:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484763904 00000100:00100000:3.0:1787787270.081361:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484763904 00000100:00100000:3.0:1787787270.081576:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:3.0:1787787270.081588:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:12193:x1874630484763904:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1787787270.081895:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12193:x1874630484763904:12345-192.168.204.31@tcp:35:bash.0 Request processed in 309us (1556us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787787270.081904:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 36 00000040:00080000:1.0:1787787270.121454:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787270.121463:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787270.121572:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787787270.121579:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787270.157662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.157867:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484764160 00000100:00100000:3.0:1787787270.157877:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484764160 00000100:00100000:3.0:1787787270.157941:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 158 00000100:00100000:3.0:1787787270.157951:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12203:x1874630484764160:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787270.157976:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787270.157999:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8310 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787270.158093:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787787270.158244:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9798 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8310 expref: 23 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.158258:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:3.0:1787787270.158269:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787270.158275:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a9798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8310 expref: 23 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.158290:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7800, rc 0) 00000100:00100000:3.0:1787787270.158343:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:12203:x1874630484764160:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 393us (691us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1787787270.158351:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 158 00000100:00100000:1.0:1787787270.167414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.169369:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484764416 00000100:00100000:0.0:1787787270.169384:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484764416 00000100:00100000:0.0:1787787270.169464:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:0.0:1787787270.169474:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:12203:x1874630484764416:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787270.169713:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:12203:x1874630484764416:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 239us (2308us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787787270.169722:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:0.0:1787787270.265753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.266049:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484764544 00000100:00100000:2.0:1787787270.266060:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484764544 00000100:00100000:2.0:1787787270.266129:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 159 00000100:00100000:2.0:1787787270.266177:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:12209:x1874630484764544:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787270.266202:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787270.266222:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a97a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8317 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.268207:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a97ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.268227:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a97ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.268238:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a97ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787270.268337:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787787270.268341:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787270.268377:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a97ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.268409:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a97a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8317 expref: 25 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.268429:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a97ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8317 expref: 24 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.268438:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787270.268441:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787270.268445:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787270.268618:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:12209:x1874630484764544:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2443us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787270.268628:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 159 00000100:00100000:1.0:1787787270.274926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.275035:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484764800 00000100:00100000:0.0:1787787270.275046:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484764800 00000100:00100000:0.0:1787787270.275106:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 160 00000100:00100000:0.0:1787787270.275115:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:12209:x1874630484764800:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787270.275173:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787270.275296:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a97b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c831e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.275648:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a97bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.275663:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a97bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.275675:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a97bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787270.275686:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787787270.276114:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a97b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c831e expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.276353:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a97bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c831e expref: 26 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.276363:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:0.0:1787787270.276366:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787270.276370:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a800, rc 0) 00000100:00100000:0.0:1787787270.276591:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+26:12209:x1874630484764800:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1475us (1676us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1787787270.276599:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 160 00000100:00100000:1.0:1787787270.282578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.283946:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765056 00000100:00100000:0.0:1787787270.283969:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765056 00000100:00100000:0.0:1787787270.284036:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 161 00000100:00100000:0.0:1787787270.284047:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+26:12209:x1874630484765056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787270.284070:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787270.284111:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a97c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8325 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.284245:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a97d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.284261:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a97d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.284273:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a97d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787270.284284:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:1.0:1787787270.284782:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1787787270.285245:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a97c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8325 expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.285266:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a97d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8325 expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.285275:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:0.0:1787787270.285278:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787787270.285282:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b800, rc 0) 00000100:00100000:0.0:1787787270.285350:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:12209:x1874630484765056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1305us (2784us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1787787270.285358:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 161 00000100:00100000:3.0:1787787270.289024:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765184 00000100:00100000:3.0:1787787270.289040:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765184 00000100:00100000:3.0:1787787270.289128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:3.0:1787787270.289169:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:2394:x1874630484765184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787270.289189:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787270.289220:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a97bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c831e expref: 28 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.289241:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:3.0:1787787270.289246:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787270.289314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:2394:x1874630484765184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 149us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.289322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:1.0:1787787270.298287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.298386:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765312 00000100:00100000:3.0:1787787270.298397:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765312 00000100:00100000:3.0:1787787270.298461:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:3.0:1787787270.298472:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2392:x1874630484765312:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1787787270.298516:0:13816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.298557:0:13816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.298567:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787270.298571:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787270.298576:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.298613:0:13816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.298630:0:13816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 6 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787270.298644:0:13816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13816:1874630503703808:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787270.298738:0:13816:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787270.304657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.304788:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765440 00000100:00100000:2.0:1787787270.304798:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765440 00002000:00100000:2.0:1787787270.304863:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9870c3ef92c0 x1874630484765440/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:131/0 lens 504/0 e 0 to 0 dl 1787787281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787270.304875:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870c3ef92c0 with x1874630484765440 ext(0->12) 00010000:00010000:2.0:1787787270.304885:0:8449:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 7 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.304904:0:8449:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 7 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787270.304914:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9870c3ef92c0 00000100:00100000:2.0:1787787270.304954:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:2.0:1787787270.304984:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484765440:12345-192.168.204.31@tcp:4:lfs.0 00000100:00100000:2.0:1787787270.306661:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484765440:12345-192.168.204.31@tcp:4:lfs.0 Request processed in 1672us (2138us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787787270.306674:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00002000:00100000:2.0:1787787270.306684:0:8449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9870c3ef92c0 x1874630484765440/t4294967306(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:131/0 lens 504/448 e 0 to 0 dl 1787787281 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787270.306695:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870c3ef92c0 with x1874630484765440 ext(0->12) 00010000:00010000:2.0:1787787270.306703:0:8449:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 9 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.306720:0:8449:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 9 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787270.306728:0:8449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9870c3ef92c0 00000100:00100000:3.0:1787787270.306845:0:13816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13816:1874630503703808:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787270.306870:0:13816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787270.313470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.315027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765568 00000100:00100000:3.0:1787787270.315040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765568 00010000:00010000:3.0:1787787270.315093:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 9 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787270.316912:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:0.0:1787787270.316937:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484765568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787270.316956:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787787270.316975:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787787270.316979:0:6512:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787787270 00002000:00010000:0.0:1787787270.316981:0:6512:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787787270 00002000:00010000:0.0:1787787270.316984:0:6512:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787787270 00002000:00010000:0.0:1787787270.316986:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787787270.316993:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 9 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.317011:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 9 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.317036:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be886973/0x11620bc3f30a9791 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8309 expref: 9 pid: 8441 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.317066:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787270.317070:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787270.317076:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.317086:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.317121:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787270.317294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484765568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 307us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787270.317304:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 83 00010000:00010000:3.0:1787787270.317508:0:13816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317519:0:13816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317541:0:13816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317549:0:13816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317558:0:13816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317564:0:13816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787270.317568:0:13816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317576:0:13816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317588:0:13816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.317608:0:13816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000839d961a/0x11620bc3f30a97de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787270.317670:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484765312:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 19199us (19396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.317678:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:2.0:1787787270.323913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.324061:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765824 00000100:00100000:0.0:1787787270.324072:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765824 00000100:00100000:0.0:1787787270.324180:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:0.0:1787787270.324191:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3664050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12209:x1874630484765824:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:0.0:1787787270.324255:0:6531:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a97d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8325 expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787270.324704:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787787270.324742:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787787270.325050:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1787787270.325100:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.325119:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 31 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.325179:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.325219:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 31 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.325235:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 31 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787270.325252:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48230c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874630503703936:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787270.325336:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787270.331641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.331773:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48230c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874630503703936:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787270.331801:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787270.332009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484765952 00000100:00100000:2.0:1787787270.332015:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484765952 00010000:00010000:2.0:1787787270.332051:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 32 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787270.332127:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:2.0:1787787270.332191:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:2391:x1874630484765952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787270.332207:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787270.332213:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 32 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.332233:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 32 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.332275:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a977c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82fb expref: 32 pid: 6528 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.332291:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:2.0:1787787270.332296:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.332304:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.332311:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.332331:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787270.332394:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+31:2391:x1874630484765952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 206us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787270.332402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 84 00010000:00010000:1.0:1787787270.332457:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.332465:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787270.332584:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787787270.332705:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787787270.332788:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503704064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787787270.332887:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787270.332920:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787270.333052:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704064 00000100:00100000:3.0:1787787270.333058:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704064 00000100:00100000:3.0:1787787270.333119:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787787270.333128:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6531:x1874630503704064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787270.333696:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6531:x1874630503704064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 558us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.333704:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1787787270.337809:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787270.337897:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503704064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787787270.338073:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1787787270.338180:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503704192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787787270.338244:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787270.338372:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787270.338454:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704192 00000100:00100000:3.0:1787787270.338461:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704192 00000100:00100000:3.0:1787787270.338516:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787787270.338531:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6531:x1874630503704192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787270.338662:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6531:x1874630503704192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (417us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787787270.338671:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787787270.338737:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503704192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787787270.338778:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787787270.338810:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.338821:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.338829:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.338836:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787270.338840:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.338848:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.338863:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:1.0:1787787270.338866:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787787270.338871:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787270.338891:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a97e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787270.338982:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787787270.339080:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787787270.339092:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414520952531ns, next at 415520950524ns, rc = 0 00000001:00080000:1.0:1787787270.339098:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787787270.339119:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19900) 00010000:00010000:1.0:1787787270.339122:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787787270.339162:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a97d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8325 expref: 35 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787270.339256:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3664050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:12209:x1874630484765824:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 15066us (15351us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787787270.339404:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 38 00000020:00080000:1.0:1787787270.339410:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787787270.348397:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.348515:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484766080 00000100:00100000:2.0:1787787270.348526:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484766080 00000100:00100000:2.0:1787787270.348592:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 162 00000100:00100000:2.0:1787787270.348603:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:12209:x1874630484766080:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787270.348627:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787270.348651:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a97ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c832c expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.348730:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a97ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c832c expref: 35 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.348745:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a97ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c832c expref: 35 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.348764:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787270.348767:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787270.348772:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2400, rc 0) 00000100:00100000:2.0:1787787270.348837:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:12209:x1874630484766080:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 236us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787270.348845:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 162 00000100:00100000:1.0:1787787270.362868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.362939:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484766336 00000100:00100000:3.0:1787787270.362950:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484766336 00000100:00100000:3.0:1787787270.363033:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:3.0:1787787270.363052:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:12209:x1874630484766336:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787270.363489:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+36:12209:x1874630484766336:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 446us (629us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787787270.363497:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00000040:00080000:1.0:1787787270.442422:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787270.480244:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.480477:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484766592 00000100:00100000:3.0:1787787270.480487:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484766592 00000100:00100000:3.0:1787787270.480547:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 163 00000100:00100000:3.0:1787787270.480557:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+36:12219:x1874630484766592:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787270.480580:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787270.480599:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a97f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8333 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787270.480692:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787787270.480786:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a97f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8333 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.480814:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:3.0:1787787270.480817:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787270.480822:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30a97f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8333 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.480836:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7800, rc 0) 00000100:00100000:3.0:1787787270.480902:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12219:x1874630484766592:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 346us (676us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787787270.480909:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 163 00000100:00100000:1.0:1787787270.485709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.485853:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484766720 00000100:00100000:3.0:1787787270.485863:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484766720 00000100:00100000:3.0:1787787270.485980:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 164 00000100:00100000:3.0:1787787270.486003:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12219:x1874630484766720:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1787787270.486075:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486091:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486102:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486112:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486119:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486125:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486271:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486280:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486288:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787270.486351:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486364:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486375:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486382:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486387:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787270.486391:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486398:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486410:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787270.486413:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787270.486417:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486424:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30a9801 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486438:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486445:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486451:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486456:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787270.486465:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486471:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486479:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:3.0:1787787270.486481:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787270.486484:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486490:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30a9808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486500:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486506:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486512:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486517:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787270.486520:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486525:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486532:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787270.486535:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787270.486544:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.486551:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a980f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787270.486622:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12219:x1874630484766720:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 619us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.486629:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 164 00000100:00100000:1.0:1787787270.489651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.489710:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484766976 00000100:00100000:0.0:1787787270.489720:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484766976 00000100:00100000:0.0:1787787270.489818:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:0.0:1787787270.489829:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12219:x1874630484766976:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787270.490040:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:12219:x1874630484766976:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 213us (397us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787787270.490048:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:2.0:1787787270.505527:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787270.505551:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4821a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503704320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787270.505651:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787270.506277:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704320 00000100:00100000:0.0:1787787270.506286:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704320 00000100:00100000:0.0:1787787270.506362:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787787270.506374:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503704320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787270.506409:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787270.506473:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503704320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787270.506480:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787787270.506663:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4821a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503704320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787270.534714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.534826:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484767232 00000100:00100000:2.0:1787787270.534835:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484767232 00000100:00100000:2.0:1787787270.534901:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:2.0:1787787270.534912:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:12222:x1874630484767232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787270.534937:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787270.534958:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9816 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c833a expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535034:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535063:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535074:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535086:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535093:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535099:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535367:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535376:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535385:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787270.535395:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787787270.535474:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535481:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535487:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535500:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787270.535504:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535511:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535523:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787270.535526:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787270.535530:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535536:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a981d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535551:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535557:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535563:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535568:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787270.535571:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535577:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535596:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:2.0:1787787270.535598:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787270.535601:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535607:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535644:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9816 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 41 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535848:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 40 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.535857:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787270.535860:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787270.535863:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2000, rc 0) 00000100:00100000:2.0:1787787270.535932:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+40:12222:x1874630484767232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1023us (1228us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787787270.535941:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:1.0:1787787270.540470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.540566:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484767360 00000100:00100000:3.0:1787787270.540576:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484767360 00000100:00100000:3.0:1787787270.540764:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:3.0:1787787270.540776:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+40:12222:x1874630484767360:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:3.0:1787787270.540847:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540865:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540878:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540913:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540920:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540927:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540933:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787270.540950:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540958:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540970:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787270.540973:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787270.540977:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.540984:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787270.541059:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+40:12222:x1874630484767360:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 286us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787270.541067:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:3.0:1787787270.551393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.551585:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484767616 00000100:00100000:0.0:1787787270.551596:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484767616 00000100:00100000:0.0:1787787270.551665:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:0.0:1787787270.551676:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+40:12222:x1874630484767616:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787270.551896:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+41:12222:x1874630484767616:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 222us (513us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787787270.551904:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:1.0:1787787270.834601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.837249:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484767872 00000100:00100000:0.0:1787787270.837264:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484767872 00000100:00100000:0.0:1787787270.837406:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:0.0:1787787270.837418:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+41:12253:x1874630484767872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1787787270.837442:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787270.837465:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9840 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8341 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.837590:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9847 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.837606:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.837629:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787270.837657:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787787270.837762:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a9840 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8341 expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.837781:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8341 expref: 43 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.837790:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787270.837793:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787270.837797:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b800, rc 0) 00000100:00100000:0.0:1787787270.837869:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:12253:x1874630484767872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 453us (3277us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787787270.837877:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:2.0:1787787270.852813:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787270.853038:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484768128 00000100:00100000:0.0:1787787270.853049:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484768128 00000100:00100000:0.0:1787787270.853225:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:0.0:1787787270.853236:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:12253:x1874630484768128:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1787787270.853466:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:12253:x1874630484768128:12345-192.168.204.31@tcp:35:cat.0 Request processed in 232us (664us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787787270.853484:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:3.0:1787787270.856818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.857438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484768256 00000100:00100000:2.0:1787787270.857450:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484768256 00000100:00100000:2.0:1787787270.857542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787270.857553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:2393:x1874630484768256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787270.857570:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787270.857597:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a9847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8341 expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.857633:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787270.857638:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787270.857692:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:2393:x1874630484768256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 142us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787270.857700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787270.909606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.909699:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484768512 00000100:00100000:3.0:1787787270.909710:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484768512 00000100:00100000:3.0:1787787270.909776:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 168 00000100:00100000:3.0:1787787270.909788:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:12259:x1874630484768512:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1787787270.909813:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787270.909816:0:7753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787787270.909844:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30a97ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8317 expref: 43 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.909864:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787270.909869:0:7753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787270.909902:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9855 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8348 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.910008:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.910022:0:7753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 43 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.910031:0:7753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.910062:0:7753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 43 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.910076:0:7753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 43 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787270.910090:0:7753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503704448:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787270.911471:0:7753:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787270.921482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.921530:0:7753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7753:1874630503704448:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787270.921560:0:7753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787270.921628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484768640 00000100:00100000:0.0:1787787270.921636:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484768640 00010000:00010000:0.0:1787787270.921675:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 44 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787270.921710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:0.0:1787787270.921730:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:2391:x1874630484768640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787270.921746:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787270.921753:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 44 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.921766:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 44 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.921788:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a982b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c833a expref: 44 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.921803:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787270.921808:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.921818:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787270.922099:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.922446:0:7753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.922455:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787270.922475:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787787270.922604:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2a00/0x11620bc3f30a9855 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 45 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.922620:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 44 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.922628:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787270.922632:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787270.922634:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3200, rc 0) 00000100:00100000:2.0:1787787270.922730:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:12259:x1874630484768512:12345-192.168.204.31@tcp:101:dd.0 Request processed in 12944us (13134us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787787270.922747:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 168 00010000:00010000:0.0:1787787270.922817:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787270.922841:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:2391:x1874630484768640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1113us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787270.922850:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:0.0:1787787270.929388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787270.929468:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484768768 00000100:00100000:2.0:1787787270.929478:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484768768 00000100:00100000:2.0:1787787270.929540:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 169 00000100:00100000:2.0:1787787270.929550:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:12259:x1874630484768768:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:2.0:1787787270.929574:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787270.929600:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a986a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c834f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.929637:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.929653:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.929665:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.929784:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a986a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 45 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.929801:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787270.929811:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787270.929813:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787270.929817:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3200, rc 0) 00000100:00100000:2.0:1787787270.929899:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:12259:x1874630484768768:12345-192.168.204.31@tcp:101:dd.0 Request processed in 351us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787270.929915:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 169 00000100:00100000:1.0:1787787270.935957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787270.937333:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484769024 00000100:00100000:3.0:1787787270.937346:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484769024 00000100:00100000:3.0:1787787270.937413:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 170 00000100:00100000:3.0:1787787270.937422:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:12259:x1874630484769024:12345-192.168.204.31@tcp:36:dd.0 00010000:00010000:3.0:1787787270.937668:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.937686:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.937712:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787270.937757:0:13672:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1787787270.937781:0:13672:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ba34bbc reply state 00000000df12bc64 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.937793:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787270.937801:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787270.937803:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787270.937807:0:13672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787270.937915:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:12259:x1874630484769024:12345-192.168.204.31@tcp:36:dd.0 Request processed in 494us (1972us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1787787270.937922:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 170 00000020:00080000:3.0:1787787270.937927:0:13672:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787787270.953556:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787271.017991:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503704960:0@lo:400:kworker.0 00000100:00100000:3.0:1787787271.018069:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787271.018405:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503705472:0@lo:400:kworker.0 00000100:00100000:3.0:1787787271.018471:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787271.018545:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503704576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787271.018552:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503705984:0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.018593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787271.018594:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787271.018614:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704960 00000100:00100000:1.0:1787787271.018622:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704960 00000100:00100000:2.0:1787787271.018678:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503704704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787271.018678:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705472 00000100:00100000:1.0:1787787271.018684:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705472 00000100:00100000:2.0:1787787271.018719:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503704832:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.018730:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787787271.018744:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503704960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.018751:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787271.018779:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503705344:0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.018813:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787271.018815:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503704960:12345-0@lo:400:kworker.0 Request processed in 72us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.018824:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787787271.018839:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503705856:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.018846:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787787271.018857:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503705472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.018867:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787271.018888:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503706368:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.018898:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503705472:12345-0@lo:400:kworker.0 Request processed in 44us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.018906:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787787271.018914:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787271.018927:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787271.018940:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787271.018946:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503706496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787271.019025:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787271.019046:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705856 00000100:00100000:1.0:1787787271.019051:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705856 00000100:00100000:2.0:1787787271.019066:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704832 00000100:00100000:2.0:1787787271.019071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704832 00000100:00100000:1.0:1787787271.019082:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503706368 00000100:00100000:1.0:1787787271.019089:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503706368 00000100:00100000:2.0:1787787271.019106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787787271.019114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503704832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.019168:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787787271.019177:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503705856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503704832:12345-0@lo:400:kworker.0 Request processed in 84us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787271.019205:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787787271.019223:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503705856:12345-0@lo:400:kworker.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.019231:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787787271.019243:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705344 00000100:00100000:2.0:1787787271.019248:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705344 00000100:00100000:1.0:1787787271.019252:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787787271.019265:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503706368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019271:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503706496 00000100:00100000:2.0:1787787271.019275:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503706496 00000100:00100000:2.0:1787787271.019293:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787787271.019309:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503706368:12345-0@lo:400:kworker.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787271.019311:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503705344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.019325:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787787271.019354:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787271.019368:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503705344:12345-0@lo:400:kworker.0 Request processed in 59us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787271.019374:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503704960:0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019379:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787787271.019395:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787787271.019401:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503706496:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787271.019406:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503705472:0@lo:400:kworker.0 00000004:00000024:2.0:1787787271.019427:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787787271.019449:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705984 00000100:00100000:3.0:1787787271.019454:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705984 00000100:00100000:2.0:1787787271.019469:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503706496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787271.019476:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787787271.019506:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787787271.019511:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503706496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787271.019518:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503705984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019527:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503704832:0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019539:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503705344:0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019551:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503705856:0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.019564:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503706368:0@lo:400:kworker.0 00000100:00100000:3.0:1787787271.019577:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503705984:12345-0@lo:400:kworker.0 Request processed in 61us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787271.019585:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787787271.019621:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503705984:0@lo:400:kworker.0 00000100:00080000:1.0:1787787271.019797:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787271.020435:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503705088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787271.020479:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503705600:0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787271.020533:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503706112:0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020549:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787271.020575:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705088 00000100:00100000:0.0:1787787271.020579:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705088 00000100:00100000:0.0:1787787271.020606:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787787271.020612:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503705088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020644:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503705088:12345-0@lo:400:kworker.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.020651:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787787271.020676:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503705088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020691:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705600 00000100:00100000:0.0:1787787271.020694:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705600 00000100:00100000:0.0:1787787271.020716:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503706112 00000100:00100000:0.0:1787787271.020718:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503706112 00000100:00100000:0.0:1787787271.020733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787787271.020738:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503705600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020765:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503705600:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.020770:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787787271.020780:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787787271.020785:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.020803:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503706112:12345-0@lo:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.020818:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00080000:0.0:1787787271.020848:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43ded00 x1874630503705600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787271.020858:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503705600:0@lo:400:kworker.0 00010000:00080000:0.0:1787787271.020867:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43df0c0 x1874630503706112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787271.020874:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503706112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.020950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787271.020982:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503705216:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.021007:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787271.021022:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503705728:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.021043:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787271.021058:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503706240:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.021084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787271.021114:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787271.021157:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705728 00000100:00100000:1.0:1787787271.021161:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705728 00000100:00100000:1.0:1787787271.021189:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503706240 00000100:00100000:1.0:1787787271.021192:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503706240 00000100:00100000:1.0:1787787271.021211:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787787271.021216:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503705728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.021251:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503705728:12345-0@lo:400:kworker.0 Request processed in 35us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.021257:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787787271.021269:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787787271.021275:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503706240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.021300:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503706240:12345-0@lo:400:kworker.0 Request processed in 26us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.021306:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1787787271.021318:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787271.021320:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787271.021335:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503705728:0@lo:400:kworker.0 00000100:00100000:1.0:1787787271.021353:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503706240:0@lo:400:kworker.0 00000100:00100000:0.0:1787787271.021414:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704576 00000100:00100000:0.0:1787787271.021419:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704576 00000100:00100000:0.0:1787787271.021450:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503704704 00000100:00100000:0.0:1787787271.021453:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503704704 00000100:00100000:3.0:1787787271.021455:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787787271.021464:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503704576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787271.021465:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787787271.021470:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503704704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787271.021484:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00002000:00000024:0.0:1787787271.021484:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787787271.021517:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503704576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787271.021523:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787787271.021525:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503704704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.021531:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787787271.021543:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503705216 00000100:00100000:3.0:1787787271.021547:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503705216 00000100:00100000:3.0:1787787271.021645:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787787271.021652:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503705216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787271.021683:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503705216:12345-0@lo:400:kworker.0 Request processed in 32us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787271.021688:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787787271.021804:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503704704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787271.021815:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503705216:0@lo:400:kworker.0 00000100:00100000:2.0:1787787271.021845:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503704576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787271.202584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787271.202655:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484769152 00000100:00100000:1.0:1787787271.202667:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484769152 00000100:00100000:1.0:1787787271.202748:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 171 00000100:00100000:1.0:1787787271.202758:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:12273:x1874630484769152:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:1.0:1787787271.202783:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787271.202808:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a987f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8356 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787787271.202809:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787271.202882:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.202898:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.202911:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.202922:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.202930:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.202936:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.203032:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.203062:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 48 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.203071:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.203106:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 48 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.203133:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 48 pid: 7753 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787271.203173:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503706624:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787271.203278:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc41126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787271.207058:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503706624:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787271.207091:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787271.208296:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787271.208465:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484769408 00000100:00100000:1.0:1787787271.208473:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484769408 00000100:00100000:1.0:1787787271.208525:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:1.0:1787787271.208534:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4823840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+49:6162:x1874630484769408:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787787271.208842:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4823840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:6162:x1874630484769408:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 307us (548us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787787271.208850:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:1.0:1787787271.218995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787271.219173:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484769536 00000100:00100000:2.0:1787787271.219183:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484769536 00010000:00010000:2.0:1787787271.219225:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 50 pid: 7753 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787271.219298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:2.0:1787787271.219309:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:2391:x1874630484769536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787271.219324:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787271.219331:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 50 pid: 7753 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787271.219348:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 50 pid: 7753 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787271.219371:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3200/0x11620bc3f30a985c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8348 expref: 50 pid: 7753 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787271.219386:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787271.219391:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787271.219401:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787271.219409:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787271.219441:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787271.219495:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+49:2391:x1874630484769536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 188us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787271.219502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 86 00010000:00010000:0.0:1787787271.219571:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219589:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787271.219638:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787787271.219643:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787271.219662:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219674:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219684:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219691:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219699:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219705:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.219709:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219716:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219725:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787271.219728:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.219731:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219746:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9886 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219759:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219765:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219772:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219777:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.219780:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219786:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219793:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:0.0:1787787271.219795:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.219798:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219804:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a988d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.219844:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a987f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8356 expref: 49 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.221184:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8356 expref: 48 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.221207:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.221210:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787271.221215:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4a00, rc 0) 00000100:00100000:0.0:1787787271.221286:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+48:12273:x1874630484769152:12345-192.168.204.31@tcp:101:stat.0 Request processed in 18529us (18712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.221295:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 171 00000100:00100000:1.0:1787787271.301878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.301954:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484769792 00000100:00100000:0.0:1787787271.301965:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484769792 00000100:00100000:0.0:1787787271.302029:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 172 00000100:00100000:0.0:1787787271.302039:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+48:12279:x1874630484769792:12345-192.168.204.31@tcp:36:truncate.0 00010000:00010000:0.0:1787787271.302096:0:7753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787271.302682:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9894 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8356 expref: 48 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.302708:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.302713:0:7753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787271.302875:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.302889:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.302901:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787271.302942:0:7753:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787787271.302961:0:7753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c05a3b5 reply state 0000000034923d1c transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.302989:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.302997:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.303000:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787271.303003:0:7753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787271.303103:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:12279:x1874630484769792:12345-192.168.204.31@tcp:36:truncate.0 Request processed in 1065us (1236us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787787271.303122:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 172 00000020:00080000:0.0:1787787271.303129:0:7753:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787787271.477526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.477651:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484769920 00000100:00100000:0.0:1787787271.477667:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484769920 00000100:00100000:0.0:1787787271.477758:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 173 00000100:00100000:0.0:1787787271.477771:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+50:12294:x1874630484769920:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:0.0:1787787271.477799:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787271.477825:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a98a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c835d expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.477898:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.477914:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.477926:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.477938:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.477967:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.477975:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478054:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478065:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478073:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787271.478188:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787787271.478194:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787271.478231:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478245:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478255:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478263:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478281:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478299:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.478315:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478328:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478342:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787271.478346:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.478350:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478358:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a98a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478375:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478382:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478388:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478394:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.478397:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478404:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478423:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:0.0:1787787271.478426:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.478429:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478436:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a98b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478475:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a98a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 52 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478491:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 51 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.478499:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.478501:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787271.478504:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:0.0:1787787271.478583:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+51:12294:x1874630484769920:12345-192.168.204.31@tcp:101:stat.0 Request processed in 814us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.478591:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 173 00000100:00100000:3.0:1787787271.551982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.552909:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484770176 00000100:00100000:0.0:1787787271.552922:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484770176 00000100:00100000:0.0:1787787271.553073:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 174 00000100:00100000:0.0:1787787271.553237:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+51:12304:x1874630484770176:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787271.553261:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787271.553284:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a98be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8364 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787271.553592:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787787271.553834:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a98be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8364 expref: 53 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.553851:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:0.0:1787787271.553855:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787271.553860:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a98be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8364 expref: 53 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.553877:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:0.0:1787787271.553953:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:12304:x1874630484770176:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 722us (1985us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1787787271.553962:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 174 00000100:00100000:2.0:1787787271.559852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787271.560901:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484770432 00000100:00100000:1.0:1787787271.560914:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484770432 00000100:00100000:1.0:1787787271.560996:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:1.0:1787787271.561017:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3665c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:12304:x1874630484770432:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1787787271.561689:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3665c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:12304:x1874630484770432:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 671us (1843us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787787271.561698:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:3.0:1787787271.631701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787271.632324:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484770688 00000100:00100000:1.0:1787787271.632336:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484770688 00000100:00100000:1.0:1787787271.632401:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 175 00000100:00100000:1.0:1787787271.632412:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+53:12310:x1874630484770688:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787271.632437:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787271.632458:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a98cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c836b expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.632574:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.632592:0:13825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 54 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.632603:0:13825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.632642:0:13825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 54 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.632657:0:13825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 54 pid: 13672 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787271.632672:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503706752:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787271.633978:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787271.639938:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503706752:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787271.639972:0:13825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787271.641343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.641449:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484770816 00000100:00100000:0.0:1787787271.641458:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484770816 00010000:00010000:0.0:1787787271.641507:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 55 pid: 13672 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787271.641547:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:0.0:1787787271.641557:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:2392:x1874630484770816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787271.641571:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787271.641578:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 55 pid: 13672 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.641592:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 55 pid: 13672 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.641631:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c835d expref: 55 pid: 13672 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.641651:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.641656:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.641666:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.641673:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.641705:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787271.642723:0:13825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.642736:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787271.642758:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787787271.642906:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a98cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 56 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.642925:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 55 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.642933:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:1.0:1787787271.642935:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787271.642938:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4600, rc 0) 00000100:00100000:0.0:1787787271.643056:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:2392:x1874630484770816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1498us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.643067:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:1.0:1787787271.644623:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:12310:x1874630484770688:12345-192.168.204.31@tcp:101:bash.0 Request processed in 12206us (12936us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787787271.644636:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 175 00000100:00100000:0.0:1787787271.649917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787271.649989:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484771072 00000100:00100000:3.0:1787787271.650023:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484771072 00000100:00100000:3.0:1787787271.650089:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 176 00000100:00100000:3.0:1787787271.650099:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4821e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:12310:x1874630484771072:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:3.0:1787787271.650912:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.650936:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.650948:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787271.650994:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1787787271.651469:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000560cc720 reply state 0000000088168373 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.651483:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.651500:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787271.651503:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787271.651507:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787271.651649:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4821e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:12310:x1874630484771072:12345-192.168.204.31@tcp:36:bash.0 Request processed in 1550us (1740us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787787271.651658:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 176 00000020:00080000:3.0:1787787271.651664:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787787271.662672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787271.662982:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484771200 00000100:00100000:1.0:1787787271.662994:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484771200 00000100:00100000:1.0:1787787271.663056:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 177 00000100:00100000:1.0:1787787271.663066:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:12310:x1874630484771200:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787271.663584:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787271.663608:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a98e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.663916:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.663932:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 58 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.663941:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.663977:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 58 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.663991:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 58 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787271.664006:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503706880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787271.667816:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787271.676789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787271.677073:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484771328 00000100:00100000:3.0:1787787271.677082:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484771328 00010000:00010000:3.0:1787787271.677178:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 59 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787271.677241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:3.0:1787787271.677251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:2392:x1874630484771328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787271.677266:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787271.677274:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 59 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.677288:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 59 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.677309:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787271.677314:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.677323:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.677331:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787271.677352:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787271.677415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:2392:x1874630484771328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 165us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787271.677423:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 88 00010000:00010000:1.0:1787787271.677669:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a98d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c836b expref: 58 pid: 13825 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787271.677686:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503706880:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787271.677708:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.677727:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.677733:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787271.677782:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787787271.677787:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787271.677808:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.677838:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a98e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8372 expref: 58 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.677853:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8372 expref: 57 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.677861:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:1.0:1787787271.677864:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787271.677867:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4a00, rc 0) 00000100:00100000:1.0:1787787271.677890:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:12310:x1874630484771200:12345-192.168.204.31@tcp:101:bash.0 Request processed in 14827us (15230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.677898:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 177 00000100:00100000:0.0:1787787271.684248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787271.684386:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484771584 00000100:00100000:3.0:1787787271.684398:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484771584 00000100:00100000:3.0:1787787271.684460:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:3.0:1787787271.684470:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+57:12310:x1874630484771584:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1787787271.684997:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:12310:x1874630484771584:12345-192.168.204.31@tcp:35:bash.0 Request processed in 527us (757us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787787271.685006:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:2.0:1787787271.775980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.776360:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484771840 00000100:00100000:0.0:1787787271.776370:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484771840 00000100:00100000:0.0:1787787271.776585:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 178 00000100:00100000:0.0:1787787271.776595:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:12320:x1874630484771840:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787271.776620:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787271.776641:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8379 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787271.776760:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787787271.776862:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8379 expref: 60 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.776876:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:0.0:1787787271.776880:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787271.776884:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a98f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8379 expref: 60 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.776900:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:0.0:1787787271.776966:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:12320:x1874630484771840:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 372us (993us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1787787271.776974:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 178 00000100:00100000:2.0:1787787271.782289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.784688:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484771968 00000100:00100000:0.0:1787787271.785068:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484771968 00000100:00100000:0.0:1787787271.786048:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 179 00000100:00100000:0.0:1787787271.786063:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:12320:x1874630484771968:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:0.0:1787787271.786286:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786306:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786318:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786330:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786353:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786361:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786448:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786458:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786465:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787271.786526:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786539:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786546:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786554:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786560:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.786564:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786571:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786691:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787271.786696:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.786701:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786708:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9904 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786734:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786744:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786750:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786755:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.786758:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786763:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786771:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:0.0:1787787271.786773:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.786776:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786782:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a990b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786805:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786811:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786817:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786822:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.786826:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786832:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786840:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.786842:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.786845:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.786851:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9912 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787271.786945:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:12320:x1874630484771968:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 885us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.786954:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 179 00000100:00100000:3.0:1787787271.790007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787271.790177:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484772224 00000100:00100000:1.0:1787787271.790186:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484772224 00000100:00100000:1.0:1787787271.790296:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:1.0:1787787271.790308:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:12320:x1874630484772224:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1787787271.790530:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:12320:x1874630484772224:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 224us (531us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787787271.790552:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:2.0:1787787271.842554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.842635:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484772480 00000100:00100000:0.0:1787787271.842646:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484772480 00000100:00100000:0.0:1787787271.842715:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 180 00000100:00100000:0.0:1787787271.842739:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:12323:x1874630484772480:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787271.842763:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787271.842785:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9919 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8380 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.842887:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.842902:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.842916:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.842927:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.842935:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.842941:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843059:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a992e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843069:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a992e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843077:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a992e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787271.843099:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787787271.843245:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843253:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843260:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843267:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.843271:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843278:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843290:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787271.843294:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.843298:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843304:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843318:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843324:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843341:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843346:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787271.843349:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843355:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843363:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:0.0:1787787271.843366:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787271.843369:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843375:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843416:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9919 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8380 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843429:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a992e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8380 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.843436:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.843437:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787271.843440:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a000, rc 0) 00000100:00100000:0.0:1787787271.843505:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:12323:x1874630484772480:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 768us (963us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787787271.843521:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 180 00000100:00100000:2.0:1787787271.849711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787271.849752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.850902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484772736 00000100:00100000:0.0:1787787271.850914:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484772736 00000100:00100000:0.0:1787787271.851003:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:0.0:1787787271.851026:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:2394:x1874630484772736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787271.851044:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787271.851081:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a992e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8380 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.851112:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.851118:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787271.851543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:2394:x1874630484772736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 528us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787271.851551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1787787271.851729:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484772608 00000100:00100000:1.0:1787787271.851735:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484772608 00000100:00100000:1.0:1787787271.851784:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 181 00000100:00100000:1.0:1787787271.851795:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:12323:x1874630484772608:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:1.0:1787787271.851852:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851869:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851882:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851915:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851922:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851928:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851934:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787271.851939:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851947:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851955:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:1.0:1787787271.851972:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787271.851977:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787271.851984:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a993c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787271.852039:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:12323:x1874630484772608:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 246us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787271.852047:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 181 00000100:00100000:2.0:1787787271.854331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787271.854411:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484772992 00000100:00100000:3.0:1787787271.854420:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484772992 00000100:00100000:3.0:1787787271.854474:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:3.0:1787787271.854484:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:12323:x1874630484772992:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787271.854706:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:12323:x1874630484772992:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 224us (383us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787787271.854715:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:3.0:1787787271.976645:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787271.977108:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484773248 00000100:00100000:0.0:1787787271.977118:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484773248 00000100:00100000:0.0:1787787271.977234:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 182 00000100:00100000:0.0:1787787271.977245:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:12341:x1874630484773248:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1787787271.977272:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787271.977293:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8387 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.977415:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a994a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.977432:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a994a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.977458:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a994a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787271.977471:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787787271.978754:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787271.980170:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8387 expref: 65 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.980198:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a994a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8387 expref: 64 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787271.980208:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787271.980212:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787787271.980215:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8b800, rc 0) 00000100:00100000:0.0:1787787271.980416:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12341:x1874630484773248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3048us (3657us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787787271.980426:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 182 00000100:00100000:2.0:1787787272.010633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.011617:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484773376 00000100:00100000:0.0:1787787272.011628:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484773376 00000100:00100000:0.0:1787787272.011690:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 183 00000100:00100000:0.0:1787787272.011699:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12342:x1874630484773376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787272.011725:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787272.011749:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c838e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.011841:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a995f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.011876:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.011888:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787272.011934:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787787272.011939:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787272.011957:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.011991:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c838e expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.012229:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a995f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c838e expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.012236:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787272.012239:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787272.012241:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc2a8a800, rc 0) 00000100:00100000:0.0:1787787272.012361:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12342:x1874630484773376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 662us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.012370:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 183 00000100:00100000:2.0:1787787272.016918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.017007:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484773760 00000100:00100000:3.0:1787787272.017018:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484773760 00000100:00100000:3.0:1787787272.017076:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:3.0:1787787272.017087:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12342:x1874630484773760:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787272.017542:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12342:x1874630484773760:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 455us (633us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787787272.017550:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:3.0:1787787272.022697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.023000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484773888 00000100:00100000:0.0:1787787272.023011:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484773888 00000100:00100000:0.0:1787787272.023304:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:0.0:1787787272.023314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12342:x1874630484773888:12345-192.168.204.31@tcp:103:lfs.0 00010000:00010000:0.0:1787787272.023329:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787787272.023613:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a98ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8372 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.023638:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b800/0x11620bc3f30a994a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8387 expref: 65 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.023653:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a97ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c832c expref: 64 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.023664:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787272.023669:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787272.023763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:12342:x1874630484773888:12345-192.168.204.31@tcp:103:lfs.0 Request processed in 450us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.023772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:2.0:1787787272.025936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.026929:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484774016 00000100:00100000:0.0:1787787272.026940:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484774016 00000100:00100000:0.0:1787787272.027036:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 184 00000100:00100000:0.0:1787787272.027046:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:12342:x1874630484774016:12345-192.168.204.31@tcp:58:lfs.0 00010000:00010000:0.0:1787787272.027298:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.027317:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.027328:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787272.029994:0:7753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787787272.030326:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:12342:x1874630484774016:12345-192.168.204.31@tcp:58:lfs.0 Request processed in 3274us (4392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.030428:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 184 00000100:00100000:2.0:1787787272.055231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.055437:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484774144 00000100:00100000:3.0:1787787272.055448:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484774144 00000100:00100000:3.0:1787787272.055516:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 185 00000100:00100000:3.0:1787787272.055527:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:12344:x1874630484774144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787272.055558:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787272.055593:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a996d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8395 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055681:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055695:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055707:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055719:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055726:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055733:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055818:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055828:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055835:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787272.055876:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787787272.055880:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787272.055899:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055918:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055927:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055933:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055940:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055947:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.055951:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055959:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055971:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787272.055975:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787272.055979:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.055986:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9974 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056011:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056018:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056031:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056037:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.056040:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056047:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056055:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:3.0:1787787272.056058:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787272.056061:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056066:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a997b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056094:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a996d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 65 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056118:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 64 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.056126:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787272.056128:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787272.056131:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3800, rc 0) 00000100:00100000:3.0:1787787272.057679:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12344:x1874630484774144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2137us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.057708:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 185 00000040:00080000:0.0:1787787272.171605:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787272.171615:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787272.171639:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787787272.171647:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787272.171797:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48212c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503707008:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787272.171912:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787272.181718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.181795:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484774272 00000100:00100000:3.0:1787787272.181804:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484774272 00000100:00100000:3.0:1787787272.181864:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 186 00000100:00100000:3.0:1787787272.181874:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484774272:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787787272.181906:0:6527:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787787272.182219:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484774272:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 154us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.182230:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 186 00000100:00100000:1.0:1787787272.182673:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48212c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503707008:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787272.197929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.214542:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484774400 00000100:00100000:1.0:1787787272.214556:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484774400 00000100:00100000:1.0:1787787272.214621:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 187 00000100:00100000:1.0:1787787272.214634:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4820b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12355:x1874630484774400:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787787272.214701:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214719:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214733:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214792:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214801:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214821:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214849:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214858:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214865:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787272.214908:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787787272.214912:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787272.214923:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214934:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214941:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214949:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214955:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787272.214959:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214967:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.214987:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:1.0:1787787272.214991:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787272.214995:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215003:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a9989 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215013:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215020:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215027:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215032:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787272.215035:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215042:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215048:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9870d0e3ee00) 00010000:00010000:1.0:1787787272.215051:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787272.215054:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215060:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a9990 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215088:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215106:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215113:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215119:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787272.215122:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215128:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215135:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:1.0:1787787272.215156:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787272.215159:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.215164:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a9997 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787272.215246:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4820b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12355:x1874630484774400:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 Request processed in 614us (17595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.215255:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 187 00000100:00100000:0.0:1787787272.222578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.223390:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484774656 00000100:00100000:3.0:1787787272.223401:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484774656 00000100:00100000:3.0:1787787272.223497:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 188 00000100:00100000:3.0:1787787272.223507:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4822d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12355:x1874630484774656:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787272.223527:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787272.223548:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a999e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c839c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223649:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223664:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223676:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787272.223688:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787787272.223776:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223785:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223791:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223797:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.223801:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223809:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223831:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787272.223835:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787272.223840:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223846:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223884:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a999e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c839c expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223895:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:3.0:1787787272.223898:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787272.223902:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a999e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c839c expref: 66 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.223924:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2c00, rc 0) 00000100:00100000:3.0:1787787272.223982:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4822d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484774656:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 476us (1412us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1787787272.223990:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 188 00000100:00100000:3.0:1787787272.228944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787272.229067:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484774784 00000100:00100000:2.0:1787787272.229077:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484774784 00000100:00100000:2.0:1787787272.229186:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 189 00000100:00100000:2.0:1787787272.229196:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484774784:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787272.229231:0:6528:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787272.229384:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484774784:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 188us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787272.229392:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 189 00000100:00100000:3.0:1787787272.233480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787272.233556:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484775040 00000100:00100000:2.0:1787787272.233567:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484775040 00000100:00100000:2.0:1787787272.233627:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 190 00000100:00100000:2.0:1787787272.233638:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484775040:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787272.233660:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787272.233664:0:7753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787787272.233708:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a800/0x11620bc3f30a995f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c838e expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.233729:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787272.233734:0:7753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787272.233748:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a99b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83a3 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787272.234129:0:7753:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787787272.234281:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a99ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.234293:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a99ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.234303:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a99ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.234345:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a99b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83a3 expref: 67 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.234358:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a99ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83a3 expref: 66 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.234367:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:2.0:1787787272.234369:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787272.234372:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2000, rc 0) 00000100:00100000:2.0:1787787272.234425:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12355:x1874630484775040:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 790us (995us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787787272.234442:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 190 00000100:00100000:2.0:1787787272.242025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.242116:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484775296 00000100:00100000:0.0:1787787272.242125:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484775296 00000100:00100000:0.0:1787787272.242219:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 191 00000100:00100000:0.0:1787787272.242230:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12355:x1874630484775296:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787272.242286:0:13672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787272.242313:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a99ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83a3 expref: 66 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242330:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff986fc3a1c900) 00010000:00010000:0.0:1787787272.242341:0:13672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787272.242364:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242377:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242387:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242413:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242421:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242427:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242474:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242480:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242486:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242492:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.242496:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242503:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242511:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787272.242514:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.242518:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242524:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a99c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242542:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242547:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242552:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242557:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.242560:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242564:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242572:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe3e31eec (ffff9870d4cecb00) 00010000:00010000:0.0:1787787272.242574:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.242576:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.242581:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a99cf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe3e31eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.242658:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484775296:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 430us (642us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787272.242666:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 191 00000100:00100000:2.0:1787787272.245378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.246307:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484775424 00000100:00100000:1.0:1787787272.246318:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484775424 00000100:00100000:1.0:1787787272.246415:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 192 00000100:00100000:1.0:1787787272.246432:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12355:x1874630484775424:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787272.246454:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787272.246477:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83aa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.246518:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.246532:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.246543:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.246656:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 67 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.246673:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.246681:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:1.0:1787787272.246683:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787272.246687:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4600, rc 0) 00000100:00100000:1.0:1787787272.246757:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12355:x1874630484775424:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 326us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.246764:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 192 00000100:00100000:1.0:1787787272.254071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.254446:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484775680 00000100:00100000:3.0:1787787272.254458:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484775680 00000100:00100000:3.0:1787787272.254521:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 193 00000100:00100000:3.0:1787787272.254531:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12355:x1874630484775680:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787272.254628:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.254646:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.254658:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787272.254854:0:7753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787787272.254864:0:7753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416436725481ns, next at 417436722924ns, rc = 0 00000004:00010000:3.0:1787787272.254921:0:7753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb8aaf6b reply state 000000006d4be7e7 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.254935:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.254943:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:3.0:1787787272.254959:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787787272.254963:0:7753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787272.255077:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:12355:x1874630484775680:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 547us (1013us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787787272.255085:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 193 00000100:00100000:2.0:1787787272.257982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.258389:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484775808 00000100:00100000:3.0:1787787272.258398:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484775808 00000100:00100000:3.0:1787787272.258491:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 194 00000100:00100000:3.0:1787787272.258501:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:12355:x1874630484775808:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787272.258524:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787272.258542:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83b1 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.258594:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 69 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.258608:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 69 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.258624:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:3.0:1787787272.258627:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787272.258631:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3a00, rc 0) 00000100:00100000:3.0:1787787272.258686:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+69:12355:x1874630484775808:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 188us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.258693:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 194 00000100:00100000:1.0:1787787272.261342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787272.261429:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484775936 00000100:00100000:2.0:1787787272.261439:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484775936 00000100:00100000:2.0:1787787272.261511:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1787787272.261522:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+6:2393:x1874630484775936:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787787272.261734:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2393:x1874630484775936:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 213us (400us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787787272.261742:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00080000:1.0:1787787272.262037:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787272.264003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.264081:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484776192 00000100:00100000:1.0:1787787272.264089:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484776192 00000100:00100000:1.0:1787787272.264332:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:1.0:1787787272.264344:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+69:12355:x1874630484776192:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787787272.264546:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+70:12355:x1874630484776192:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 205us (550us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1787787272.264554:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:3.0:1787787272.266251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.266278:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484776448 00000100:00100000:3.0:1787787272.266285:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484776448 00000100:00100000:3.0:1787787272.266350:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:3.0:1787787272.266359:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+70:12355:x1874630484776448:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787787272.266440:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+70:12355:x1874630484776448:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.266448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:2.0:1787787272.272556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.272645:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484776576 00000100:00100000:1.0:1787787272.272655:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484776576 00000100:00100000:1.0:1787787272.272709:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:1.0:1787787272.272718:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+70:12355:x1874630484776576:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787272.272737:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787272.272757:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a99f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83b8 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.272824:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.272840:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.272851:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787272.272892:0:13825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787272.272910:0:13825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.272936:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30a99f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b8 expref: 72 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.272963:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b8 expref: 71 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.272973:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:1.0:1787787272.272976:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787787272.272979:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4a00, rc 0) 00000100:00100000:1.0:1787787272.273042:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+71:12355:x1874630484776576:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 325us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.273049:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:3.0:1787787272.277686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.277772:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484776704 00000100:00100000:1.0:1787787272.277782:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484776704 00000100:00100000:1.0:1787787272.277839:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:1.0:1787787272.277850:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484776704:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787272.277870:0:9030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787272.277911:0:9030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83bf expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787787272.277935:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f7808, blocks: 0x0 00010000:00010000:1.0:1787787272.277955:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1787787272.277960:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787272.277969:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 8 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.277986:0:9030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 8 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.278011:0:9030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0000, rc 0) 00000100:00100000:1.0:1787787272.278074:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484776704:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 225us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.278081:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:2.0:1787787272.286233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.286293:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484776960 00000100:00100000:1.0:1787787272.286304:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484776960 00000100:00100000:1.0:1787787272.286398:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 197 00000100:00100000:1.0:1787787272.286407:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+71:12355:x1874630484776960:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787787272.286509:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+71:12355:x1874630484776960:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.286517:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 197 00000100:00100000:3.0:1787787272.289906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.290165:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777088 00000100:00100000:0.0:1787787272.290175:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777088 00000100:00100000:0.0:1787787272.290237:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:0.0:1787787272.290264:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:12355:x1874630484777088:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787272.290283:0:13816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787272.290301:0:13816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83c6 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.290335:0:13816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.290345:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787272.290349:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787272.290355:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 9 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.290390:0:13816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.290407:0:13816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.290422:0:13816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4820f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13816:1874630503707136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787272.290523:0:13816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787272.293795:0:13816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4820f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13816:1874630503707136:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787272.293832:0:13816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 9 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.293873:0:13816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:0.0:1787787272.293928:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:12355:x1874630484777088:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 3666us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.293937:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787272.294280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.294584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777216 00000100:00100000:0.0:1787787272.294594:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777216 00010000:00010000:0.0:1787787272.294628:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.294748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:0.0:1787787272.294758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c2af7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484777216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787272.294772:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787272.294867:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.294884:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.294908:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002956a671/0x11620bc3f30a9a00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83bf expref: 9 pid: 9030 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.295900:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787272.295916:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787272.295928:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.295980:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.296029:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.296044:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4820f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6514:1874630503707264:192.168.204.31@tcp:105: 00000100:00100000:0.0:1787787272.296272:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787272.304325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.304437:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777344 00000100:00100000:1.0:1787787272.304447:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777344 00002000:00100000:1.0:1787787272.304499:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff986fc43dc3c0 x1874630484777344/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:133/0 lens 504/0 e 0 to 0 dl 1787787283 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787787272.304512:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc43dc3c0 with x1874630484777344 ext(0->8) 00002000:00010000:1.0:1787787272.304518:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc43dc3c0 00000100:00100000:1.0:1787787272.304558:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:1.0:1787787272.304568:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484777344:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787787272.305454:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:2391:x1874630484777344:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 Request processed in 885us (1138us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787787272.305463:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00002000:00100000:1.0:1787787272.305470:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff986fc43dc3c0 x1874630484777344/t4294967315(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:133/0 lens 504/448 e 0 to 0 dl 1787787283 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787787272.305486:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc43dc3c0 with x1874630484777344 ext(0->8) 00002000:00010000:1.0:1787787272.305490:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc43dc3c0 00000100:00100000:0.0:1787787272.307070:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4820f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6514:1874630503707264:192.168.204.31@tcp:105: 00010000:00010000:0.0:1787787272.307113:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787272.307557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c2af7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484777216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 12799us (13277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.307570:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:2.0:1787787272.308122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.308260:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777472 00000100:00100000:3.0:1787787272.308270:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777472 00000100:00100000:3.0:1787787272.308861:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00100000:3.0:1787787272.308873:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+71:12355:x1874630484777472:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787787272.311118:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787787272.311171:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787787272.311221:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787787272.311234:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff986fc4112b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787787272.311238:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9870c4dd1a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff986fc4112c00 00000020:00080000:2.0:1787787272.311241:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9870c4dd1f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff986fc4394400 00000100:00100000:2.0:1787787272.311354:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503707392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787787272.311416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787787272.311620:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1787787272.311740:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503707520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787787272.311788:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787787272.312025:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787787272.312181:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12355:x1874630484777472:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 Request processed in 3307us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.312191:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00100000:3.0:1787787272.312232:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503707392 00000100:00100000:3.0:1787787272.312240:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503707392 00000100:00100000:3.0:1787787272.312282:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503707520 00000100:00100000:3.0:1787787272.312285:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503707520 00000100:00100000:3.0:1787787272.312304:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787787272.312311:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503707392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787787272.312334:0:8443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1787787272.312364:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f7806, atime: 0x6a8f7806, ctime: 0x6a8f7806, blocks: 0x8 00010000:00010000:3.0:1787787272.312372:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.312395:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1787787272.312401:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787272.312408:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.312425:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.312436:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.312443:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.312460:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787272.312570:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503707392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 259us (1153us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787787272.312576:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787787272.312589:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787787272.312595:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503707520:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787787272.313049:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313058:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313065:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313071:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313075:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313109:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313125:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9870d4cec200) 00010000:00010000:0.0:1787787272.313128:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.313133:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313155:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8bc00/0x11620bc3f30a972f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313173:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313179:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313185:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313190:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8be00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313193:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313205:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313213:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787272.313216:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.313219:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313235:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8be00/0x11620bc3f30a9736 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313250:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313261:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313267:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313273:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313276:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313281:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313289:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19600) 00010000:00010000:0.0:1787787272.313292:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.313294:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313300:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7000/0x11620bc3f30a9775 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313316:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313321:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313333:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313338:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313341:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313347:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313355:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787272.313358:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.313368:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313374:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2e00/0x11620bc3f30a9878 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313385:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313391:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313396:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313401:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8aa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313404:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313420:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313429:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787272.313431:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.313434:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313440:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8aa00/0x11620bc3f30a989b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313452:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313457:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313463:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313468:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313471:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313477:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313484:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787272.313486:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787272.313489:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313504:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3c00/0x11620bc3f30a98e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313517:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313523:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313529:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313534:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.313537:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313542:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313551:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:0.0:1787787272.313553:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787787272.313556:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.313568:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2c00/0x11620bc3f30a99e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787272.313779:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787787272.313783:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787787272 00002000:00010000:3.0:1787787272.313786:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787787272.313788:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787787272 -> 1787787272 00002000:00010000:3.0:1787787272.313790:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787787272.313847:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503707520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1250us (2057us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787787272.313856:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787787272.313882:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787787272.313928:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc489bc00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787787272.313936:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503707392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787787272.314224:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787272.314233:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.314244:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787272.314248:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.314257:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.314270:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.314277:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c24c0d4/0x11620bc3f30a9a0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.314304:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787272.314305:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787272.314306:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787787272.315340:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc43df840/2, rc 0, transno 4294967316 00000100:00100000:2.0:1787787272.315352:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503707520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787787272.316558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.318178:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777600 00000100:00100000:0.0:1787787272.318192:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777600 00000100:00100000:0.0:1787787272.318262:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:0.0:1787787272.318274:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2394:x1874630484777600:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787787272.322482:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787787272.322500:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787787272.322959:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484777600:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 Request processed in 4681us (6401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787272.322972:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:2.0:1787787272.328783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787272.328971:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777856 00000100:00100000:1.0:1787787272.328981:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777856 00000100:00100000:1.0:1787787272.329043:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 199 00000100:00100000:1.0:1787787272.329068:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:12355:x1874630484777856:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787272.329134:0:13825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787272.329204:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4a00/0x11620bc3f30a99f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b8 expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.329223:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:1.0:1787787272.329229:0:13825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787272.329259:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.329273:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.329283:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787272.329397:0:13825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000872e42dc reply state 00000000a0006171 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.329408:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.329415:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:1.0:1787787272.329417:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787787272.329420:0:13825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787272.329521:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:12355:x1874630484777856:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 456us (757us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1787787272.329528:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 199 00000100:00100000:3.0:1787787272.337772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.337857:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484777984 00000100:00100000:0.0:1787787272.337867:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484777984 00000100:00100000:0.0:1787787272.337927:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:0.0:1787787272.337937:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2394:x1874630484777984:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787787272.338125:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787787272.338129:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787787272 -> 1787787271 00002000:00010000:0.0:1787787272.338132:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787787270 00002000:00010000:0.0:1787787272.338134:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787787272 -> 1787787271 00002000:00010000:0.0:1787787272.338136:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787787272.338232:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2394:x1874630484777984:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 296us (469us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787787272.338240:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:1.0:1787787272.344268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.344415:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484778240 00000100:00100000:3.0:1787787272.344425:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484778240 00000100:00100000:3.0:1787787272.344482:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 200 00000100:00100000:3.0:1787787272.344491:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:12355:x1874630484778240:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787787272.344559:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.344576:0:13672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.344587:0:13672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.344620:0:13672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.344634:0:13672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 20 pid: 6528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787272.344648:0:13672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13672:1874630503707648:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787272.344729:0:13672:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787272.351071:0:13672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ee2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13672:1874630503707648:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787272.351119:0:13672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787272.352536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.352665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484778368 00000100:00100000:0.0:1787787272.352677:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484778368 00010000:00010000:0.0:1787787272.352721:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 21 pid: 6528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.352766:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:0.0:1787787272.352892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffac9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:2393:x1874630484778368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787272.352911:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787272.352918:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 21 pid: 6528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.352934:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 21 pid: 6528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.352966:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30a99dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83aa expref: 21 pid: 6528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.352980:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:0.0:1787787272.352985:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.352996:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.353003:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.353033:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787272.353104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffac9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:2393:x1874630484778368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 319us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.353111:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 90 00010000:00010000:3.0:1787787272.354579:0:13672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354596:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354636:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354643:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354651:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354657:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.354660:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354668:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354685:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:3.0:1787787272.354689:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787787272.354693:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.354698:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787272.354808:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:12355:x1874630484778240:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 Request processed in 10313us (10548us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787787272.354818:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 200 00000100:00100000:1.0:1787787272.358639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787272.358755:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484778496 00000100:00100000:2.0:1787787272.358765:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484778496 00000100:00100000:2.0:1787787272.358856:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:2.0:1787787272.358868:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2393:x1874630484778496:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787787272.358916:0:9030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.358940:0:9030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.358950:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787272.358954:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787272.358959:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.359001:0:9030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.359019:0:9030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 8 pid: 13816 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787272.359052:0:9030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9030:1874630503707776:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787272.359256:0:9030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787272.362049:0:9030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9030:1874630503707776:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787272.362084:0:9030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787272.369331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.369395:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484778624 00000100:00100000:0.0:1787787272.369405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484778624 00010000:00010000:0.0:1787787272.369450:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 9 pid: 13816 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.369500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:0.0:1787787272.369511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffa3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484778624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787272.369527:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787272.369547:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 9 pid: 13816 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.369585:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 9 pid: 13816 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.369611:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070b55972/0x11620bc3f30a9a07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83c6 expref: 9 pid: 13816 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.369630:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787272.369634:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787272.369640:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.369665:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.369703:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787272.369759:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484778624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 249us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.369767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 91 00010000:00010000:2.0:1787787272.371686:0:9030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371710:0:9030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371745:0:9030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371755:0:9030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371764:0:9030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371772:0:9030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787272.371777:0:9030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371787:0:9030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371836:0:9030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.371846:0:9030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f37993/0x11620bc3f30a9a23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787272.371976:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffa3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2393:x1874630484778496:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 Request processed in 13104us (13840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787272.371989:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:2.0:1787787272.377978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.378067:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484778880 00000100:00100000:0.0:1787787272.378079:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484778880 00000100:00100000:0.0:1787787272.378180:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 201 00000100:00100000:0.0:1787787272.378191:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:12355:x1874630484778880:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787787272.378297:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.378315:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.378341:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.378376:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.378390:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 19 pid: 6527 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.378406:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4820f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503707904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787272.378488:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787272.383062:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4820f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503707904:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787272.383105:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787272.383971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787272.384519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779008 00000100:00100000:0.0:1787787272.384528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779008 00010000:00010000:0.0:1787787272.384570:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 20 pid: 6527 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.384613:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:0.0:1787787272.384623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:2392:x1874630484779008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787272.384640:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787272.384646:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 20 pid: 6527 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.384793:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 20 pid: 6527 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.384823:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9871 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c834f expref: 20 pid: 6527 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.384841:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787272.384847:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.384858:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.384867:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.384902:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787272.384950:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.384960:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.385019:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:2392:x1874630484779008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 396us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.385028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 92 00010000:00010000:1.0:1787787272.385168:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.385181:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 19 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.385191:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.385222:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 19 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787272.385236:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 19 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787272.385250:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503708032:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787272.385325:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787272.397419:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503708032:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787272.397451:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.400681:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.400964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779136 00000100:00100000:3.0:1787787272.400974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779136 00010000:00010000:3.0:1787787272.401017:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 20 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787272.401062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00100000:3.0:1787787272.401072:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4820f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:2391:x1874630484779136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787272.401086:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787272.401104:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 20 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.401119:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 20 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.401173:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a99eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83b1 expref: 20 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.401193:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:3.0:1787787272.401199:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.401220:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.401228:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.402052:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787272.402127:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4820f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:2391:x1874630484779136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1053us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.402757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 93 00010000:00010000:3.0:1787787272.402982:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.402992:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787272.403114:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787787272.403264:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787787272.404425:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787787272.404535:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503708160:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787787272.404598:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787272.404633:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c30d2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787272.405391:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503708160 00000100:00100000:0.0:1787787272.405400:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503708160 00000100:00100000:0.0:1787787272.405459:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787787272.405468:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1874630503708160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787787272.405570:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1874630503708160:12345-0@lo:1000:mdt00_001.0 Request processed in 103us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.405588:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787787272.405907:0:6528:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1787787272.405914:0:6528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff986fc43df840, transno 4294967316 00000100:00100000:2.0:1787787272.405934:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503708160:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787787272.406069:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1787787272.406165:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503708288:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787787272.406200:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787272.406220:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787272.406234:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503708288 00000100:00100000:2.0:1787787272.406238:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503708288 00000100:00100000:2.0:1787787272.406271:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787787272.406978:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1874630503708288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787787272.407207:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1874630503708288:12345-0@lo:1000:mdt00_001.0 Request processed in 921us (1005us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787787272.407216:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787787272.410745:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6528:1874630503708288:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787787272.410927:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.410939:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.410947:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.410953:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.410957:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.410964:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.410980:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:0.0:1787787272.410983:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787272.410989:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.410995:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1800/0x11620bc3f30a9a31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411018:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411024:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411030:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411049:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8a000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787272.411052:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411057:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411066:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:0.0:1787787272.411068:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787272.411071:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411076:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a000/0x11620bc3f30a9966 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411112:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411126:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 22 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411169:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411214:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 22 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.411229:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 22 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787272.411271:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503708416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787272.411508:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787272.417134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.417381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779264 00000100:00100000:3.0:1787787272.417390:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779264 00010000:00010000:3.0:1787787272.417434:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 23 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787272.417475:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:3.0:1787787272.417485:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4823840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2392:x1874630484779264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787272.417499:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787272.417506:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 23 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.417533:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 23 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.417557:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:3.0:1787787272.417562:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.417572:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.417580:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.417600:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787272.417758:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4823840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2392:x1874630484779264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 273us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.417766:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 94 00010000:00010000:2.0:1787787272.420921:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9982 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8395 expref: 22 pid: 13672 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787272.420949:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503708416:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787272.420973:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.420983:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.420989:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421002:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421008:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421015:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421021:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787272.421025:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421052:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421067:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787272.421070:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787272.421075:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421081:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421103:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421110:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421116:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421122:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787272.421124:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421131:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421166:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc3a1ce00) 00010000:00010000:2.0:1787787272.421169:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787272.421172:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787272.421189:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a2a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787272.421950:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12355:x1874630484778880:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 43757us (43980us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787787272.421962:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 201 00000020:00080000:2.0:1787787272.421968:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787787272.424415:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787272.424423:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787787272.425033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.425068:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779520 00000100:00100000:3.0:1787787272.425082:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779520 00000100:00100000:3.0:1787787272.425136:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:3.0:1787787272.425166:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3664450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12355:x1874630484779520:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787787272.425475:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787272.425502:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1787787272.425530:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425546:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425568:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787272.425569:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00010000:00010000:3.0:1787787272.425576:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787272.425579:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787787272.425583:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425589:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425603:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787272.425691:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3664450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:12355:x1874630484779520:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 527us (662us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787787272.425699:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000020:00080000:3.0:1787787272.425704:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787787272.425747:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787272.425753:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425761:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787272.425764:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425785:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425797:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:3.0:1787787272.425800:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787787272.425810:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425815:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.425827:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787272.425828:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787272.425830:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787272.761541:0:14664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787272.761551:0:14664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787272.762676:0:14664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787787272.762688:0:14664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787272.892114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.892180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.892220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.892252:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.892279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.892306:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779776 00000100:00100000:3.0:1787787272.892315:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779776 00000100:00100000:3.0:1787787272.892365:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484780032 00000100:00100000:3.0:1787787272.892368:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484780032 00000100:00100000:3.0:1787787272.892385:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484780160 00000100:00100000:3.0:1787787272.892387:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484780160 00000100:00100000:3.0:1787787272.892407:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 322 00000100:00100000:3.0:1787787272.892416:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484779776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787272.892483:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484779776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.892490:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 322 00000100:00100000:3.0:1787787272.892507:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 323 00000100:00100000:3.0:1787787272.892513:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484780032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787272.892537:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484780032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.892561:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 323 00000100:00100000:3.0:1787787272.892574:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 324 00000100:00100000:3.0:1787787272.892580:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484780160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787272.892606:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484780160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.892612:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 324 00000100:00100000:3.0:1787787272.892633:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779904 00000100:00100000:3.0:1787787272.892637:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779904 00000100:00100000:3.0:1787787272.892668:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:3.0:1787787272.892676:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484779904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787272.892708:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484779904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.892715:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00080000:3.0:1787787272.892736:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787272.892740:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787272.892742:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787272.893113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484779648 00000100:00100000:0.0:1787787272.893119:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484779648 00000100:00100000:0.0:1787787272.893191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 387 00000100:00100000:0.0:1787787272.893201:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484779648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787272.893243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484779648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787272.893249:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 387 00000100:00100000:0.0:1787787272.941477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.948975:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484780416 00000100:00100000:3.0:1787787272.948991:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484780416 00000100:00100000:0.0:1787787272.949216:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:0.0:1787787272.949228:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:12365:x1874630484780416:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787272.949256:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787272.949277:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83cd expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.949396:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.949410:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.949424:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787272.949448:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787787272.949548:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9a46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83cd expref: 26 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.949565:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83cd expref: 25 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787272.949574:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787272.949576:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787787272.949579:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:0.0:1787787272.949652:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12365:x1874630484780416:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 425us (8184us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787787272.949660:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:1.0:1787787272.955970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787272.956065:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484780544 00000100:00100000:3.0:1787787272.956075:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484780544 00000100:00100000:3.0:1787787272.956177:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 203 00000100:00100000:3.0:1787787272.956189:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12365:x1874630484780544:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1787787272.956273:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956294:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956316:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956331:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956338:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956345:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956434:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956443:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956451:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787272.956499:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956512:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956519:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956525:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956542:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.956547:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956555:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956568:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787272.956572:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787272.956576:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956584:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956597:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956603:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956609:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956614:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.956617:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956623:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956642:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19000) 00010000:00010000:3.0:1787787272.956644:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787272.956647:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956654:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956670:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956676:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956681:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956686:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787272.956689:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956694:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956701:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19200) 00010000:00010000:3.0:1787787272.956703:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787272.956706:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787272.956712:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787272.956823:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12365:x1874630484780544:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 636us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.956832:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 203 00010000:00010000:1.0:1787787273.001278:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787273.017115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.017451:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484780800 00000100:00100000:3.0:1787787273.017463:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484780800 00000100:00100000:3.0:1787787273.017548:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 204 00000100:00100000:3.0:1787787273.017561:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12368:x1874630484780800:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787273.017581:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787273.017603:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83d4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017685:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017699:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017711:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017727:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017735:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017743:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017874:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017883:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.017891:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787273.017901:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787787273.017999:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018008:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018015:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018021:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.018025:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018031:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018043:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787273.018121:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.018402:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018422:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9a77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018438:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018445:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018450:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018455:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.018459:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018465:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018474:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19200) 00010000:00010000:3.0:1787787273.018476:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.018479:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018485:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9a7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018527:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2400/0x11620bc3f30a9a70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 28 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018541:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.018556:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.018559:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787273.018561:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3000, rc 0) 00000100:00100000:3.0:1787787273.018630:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12368:x1874630484780800:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1072us (1525us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787787273.018639:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 204 00000100:00080000:0.0:1787787273.019782:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787273.022735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.023000:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484780928 00000100:00100000:3.0:1787787273.023011:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484780928 00000100:00100000:3.0:1787787273.023076:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:3.0:1787787273.023097:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12368:x1874630484780928:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:3.0:1787787273.023184:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023202:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023213:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023248:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023256:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023264:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023270:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.023288:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023296:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023309:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.023313:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787273.023317:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.023323:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9a93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787273.023406:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12368:x1874630484780928:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 311us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.023414:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:1.0:1787787273.028702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.028781:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484781184 00000100:00100000:2.0:1787787273.028792:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484781184 00000100:00100000:2.0:1787787273.028858:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:2.0:1787787273.028868:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12368:x1874630484781184:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1787787273.029167:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:12368:x1874630484781184:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 300us (564us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787787273.029175:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:1.0:1787787273.080934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.081188:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484781440 00000100:00100000:3.0:1787787273.081198:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484781440 00000100:00100000:2.0:1787787273.081345:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 206 00000100:00100000:2.0:1787787273.081358:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:11901:x1874630484781440:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787273.081382:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787273.081405:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9a9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.081540:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.081563:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.081573:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.081607:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.081622:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 29 pid: 6527 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.081638:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874630503708544:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787273.081964:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d4ec5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787273.094267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.094679:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484781568 00000100:00100000:3.0:1787787273.094690:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484781568 00010000:00010000:3.0:1787787273.094737:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 30 pid: 6527 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787273.094792:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:3.0:1787787273.094803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:2392:x1874630484781568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787273.094822:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787273.094829:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 30 pid: 6527 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.094866:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 30 pid: 6527 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.094891:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.094897:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.094907:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.094915:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.094936:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787273.094997:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:2392:x1874630484781568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 195us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.095004:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 95 00010000:00010000:2.0:1787787273.095031:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9a85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83d4 expref: 29 pid: 6527 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.095048:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6529:1874630503708544:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787273.095070:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.095093:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.095099:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787273.095116:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787787273.095291:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9a9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.095306:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.095314:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:2.0:1787787273.095317:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787273.095319:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787273.095360:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:11901:x1874630484781440:12345-192.168.204.31@tcp:101:bash.0 Request processed in 14006us (14437us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787787273.095367:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 206 00000100:00100000:0.0:1787787273.105844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.106833:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484781696 00000100:00100000:2.0:1787787273.106847:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484781696 00000100:00100000:2.0:1787787273.106997:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 207 00000100:00100000:2.0:1787787273.107009:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:11901:x1874630484781696:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787273.107038:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787273.107063:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9aaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.107114:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a9ab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.107164:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a9ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.107178:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a9ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.107337:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9aaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83e2 expref: 31 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.107370:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a9ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83e2 expref: 30 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.107379:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:2.0:1787787273.107382:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787273.107386:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2c00, rc 0) 00000100:00100000:2.0:1787787273.107456:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11901:x1874630484781696:12345-192.168.204.31@tcp:101:bash.0 Request processed in 450us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787273.107464:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 207 00000100:00100000:1.0:1787787273.112701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.112856:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484781952 00000100:00100000:3.0:1787787273.112867:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484781952 00000100:00100000:3.0:1787787273.112936:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 208 00000100:00100000:3.0:1787787273.112946:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:11901:x1874630484781952:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:3.0:1787787273.114106:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.114127:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.114476:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787273.114758:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1787787273.114804:0:13825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ef8675b reply state 00000000a6bed90d transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.114820:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.114828:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:2.0:1787787273.114831:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787273.114835:0:13825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787787273.114923:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1787787273.115047:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:11901:x1874630484781952:12345-192.168.204.31@tcp:36:bash.0 Request processed in 2100us (2540us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787787273.115056:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 208 00000020:00080000:2.0:1787787273.115062:0:13825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787787273.120325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.120584:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484782080 00000100:00100000:3.0:1787787273.120594:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484782080 00000100:00100000:2.0:1787787273.120694:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 209 00000100:00100000:2.0:1787787273.120722:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+34:11901:x1874630484782080:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787273.120759:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787273.120780:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9ac4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83e9 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.120840:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83e9 expref: 35 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.120855:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83e9 expref: 35 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.120873:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:2.0:1787787273.120876:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787273.120880:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3400, rc 0) 00000100:00100000:2.0:1787787273.120945:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:11901:x1874630484782080:12345-192.168.204.31@tcp:101:bash.0 Request processed in 227us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787273.120952:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 209 00000100:00100000:0.0:1787787273.124512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.124719:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484782208 00000100:00100000:3.0:1787787273.124729:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484782208 00000100:00100000:3.0:1787787273.124825:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:3.0:1787787273.124835:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:11901:x1874630484782208:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787273.124853:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787273.124873:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83f0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787273.124896:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f7807, atime: 0x6a8f7806, ctime: 0x6a8f7807, blocks: 0x8 00010000:00010000:3.0:1787787273.124917:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:3.0:1787787273.124922:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787273.124929:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.124944:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.124955:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2400, rc 0) 00000100:00100000:3.0:1787787273.125017:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:11901:x1874630484782208:12345-192.168.204.31@tcp:101:bash.0 Request processed in 185us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.125025:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:1.0:1787787273.129532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.129713:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484782336 00000100:00100000:2.0:1787787273.129724:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484782336 00002000:00010000:2.0:1787787273.129778:0:8449:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1787787273.129783:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc43f3480 with x1874630484782336 ext(0->18446744073709551615) 00002000:00010000:2.0:1787787273.129797:0:8449:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc43f3480. 00000100:00100000:2.0:1787787273.129828:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:2.0:1787787273.129837:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484782336:12345-192.168.204.31@tcp:10:bash.0 00002000:00010000:2.0:1787787273.130124:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787787273.130129:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787787271 -> 1787787273 00002000:00010000:2.0:1787787273.130131:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787787270 -> 1787787270 00002000:00010000:2.0:1787787273.130200:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787787271 -> 1787787273 00002000:00010000:2.0:1787787273.130202:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787787273.130260:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484782336:12345-192.168.204.31@tcp:10:bash.0 Request processed in 423us (739us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787787273.130268:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00002000:00010000:2.0:1787787273.130272:0:8449:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1787787273.130274:0:8449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc43f3480 with x1874630484782336 ext(0->18446744073709551615) 00002000:00010000:2.0:1787787273.130280:0:8449:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc43f3480. 00000100:00100000:1.0:1787787273.226883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.227231:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484782464 00000100:00100000:3.0:1787787273.227242:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484782464 00000100:00100000:3.0:1787787273.227324:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 210 00000100:00100000:3.0:1787787273.227335:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:12382:x1874630484782464:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1787787273.227410:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227427:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227439:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227456:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227464:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227540:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227630:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227821:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227832:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787273.227887:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227899:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227915:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227922:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227929:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.227933:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227941:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227953:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787273.227957:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.227961:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227968:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9ad2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.227981:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228425:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228435:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228442:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.228451:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228459:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228468:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:3.0:1787787273.228471:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.228486:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228494:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9ad9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228512:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228518:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228524:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228529:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.228531:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228536:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228544:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.228546:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.228555:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.228562:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787273.228708:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:12382:x1874630484782464:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 1372us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.228717:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 210 00000100:00100000:0.0:1787787273.291745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.291881:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484782720 00000100:00100000:3.0:1787787273.291891:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484782720 00000100:00100000:3.0:1787787273.292193:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 211 00000100:00100000:3.0:1787787273.292204:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+35:12385:x1874630484782720:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787273.292226:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787273.292246:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83f7 expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292323:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292349:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292361:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292374:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292382:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292409:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292532:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9afc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292541:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9afc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292549:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9afc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787273.292557:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787787273.292634:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292773:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292782:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292788:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.292792:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292800:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292814:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787273.292817:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.292828:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292835:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9aee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292850:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292856:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292862:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292867:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.292870:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292876:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292885:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:3.0:1787787273.292887:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.292891:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292896:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9af5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.292939:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ae7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f7 expref: 38 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.293102:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9afc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f7 expref: 37 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.293110:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.293113:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787787273.293115:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2600, rc 0) 00000100:00100000:3.0:1787787273.293329:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12385:x1874630484782720:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1126us (1594us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787787273.293337:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 211 00000100:00100000:1.0:1787787273.297364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.297707:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484782848 00000100:00100000:2.0:1787787273.297718:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484782848 00000100:00100000:2.0:1787787273.297785:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 212 00000100:00100000:2.0:1787787273.297796:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12385:x1874630484782848:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:2.0:1787787273.297867:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.297885:0:13672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 37 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.297895:0:13672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.297929:0:13672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 37 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.297942:0:13672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 37 pid: 6529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.297956:0:13672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13672:1874630503708672:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787273.298058:0:13672:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787273.301896:0:13672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13672:1874630503708672:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787273.301929:0:13672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787273.304014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.304358:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484783104 00000100:00100000:2.0:1787787273.304367:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484783104 00000100:00100000:2.0:1787787273.304703:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:2.0:1787787273.304714:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:6161:x1874630484783104:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787787273.305001:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:6161:x1874630484783104:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 287us (995us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787787273.305009:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1787787273.308006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.308064:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484783232 00000100:00100000:3.0:1787787273.308085:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484783232 00010000:00010000:3.0:1787787273.308308:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 39 pid: 6529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787273.308358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:3.0:1787787273.308371:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c74f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:2393:x1874630484783232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787273.308387:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787273.308394:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 39 pid: 6529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.308408:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 39 pid: 6529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.308435:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9aa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83db expref: 39 pid: 6529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.308473:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.308478:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.308490:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.308497:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.308533:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787273.308586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c74f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:2393:x1874630484783232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 218us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.308594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 96 00010000:00010000:2.0:1787787273.309837:0:13672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309851:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309899:0:13672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309907:0:13672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309914:0:13672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309920:0:13672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787273.309924:0:13672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309947:0:13672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309965:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:2.0:1787787273.309968:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787273.309973:0:13672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.309979:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.310120:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12385:x1874630484782848:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 12322us (12763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787273.310203:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 212 00000100:00100000:1.0:1787787273.313061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.313353:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484783488 00000100:00100000:3.0:1787787273.313364:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484783488 00000100:00100000:3.0:1787787273.313632:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:3.0:1787787273.313645:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+37:12385:x1874630484783488:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787273.313902:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:12385:x1874630484783488:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 260us (849us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787787273.313910:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:0.0:1787787273.470604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.471602:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484783744 00000100:00100000:2.0:1787787273.471616:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484783744 00000100:00100000:2.0:1787787273.472200:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 213 00000100:00100000:2.0:1787787273.472214:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+38:12396:x1874630484783744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1787787273.472238:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787273.472262:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c83fe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.472365:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.472381:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.472393:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.472426:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.472433:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.472441:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473286:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9b26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473302:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473311:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787273.473323:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787787273.473409:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473417:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473424:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473431:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787273.473435:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473458:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473485:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787273.473489:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787273.473494:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.473501:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9b18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.474643:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.474847:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.474855:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.474861:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787273.474865:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.474873:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.475056:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787273.475061:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787273.475065:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.475101:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9b1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.475457:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30a9b11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83fe expref: 41 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.475474:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83fe expref: 40 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.475482:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:2.0:1787787273.475484:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787273.475487:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2200, rc 0) 00000100:00100000:2.0:1787787273.475858:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+40:12396:x1874630484783744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3645us (5262us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787787273.475867:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 213 00000100:00100000:0.0:1787787273.482243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.484561:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484784000 00000100:00100000:2.0:1787787273.484576:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484784000 00000100:00100000:2.0:1787787273.484639:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:2.0:1787787273.484650:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+40:12396:x1874630484784000:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1787787273.484932:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+41:12396:x1874630484784000:12345-192.168.204.31@tcp:35:cat.0 Request processed in 283us (2699us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787787273.484939:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:1.0:1787787273.504406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.504509:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484784256 00000100:00100000:2.0:1787787273.504519:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484784256 00000100:00100000:3.0:1787787273.504601:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 214 00000100:00100000:3.0:1787787273.504615:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+41:12397:x1874630484784256:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1787787273.504831:0:7753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787787273.504860:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9ac4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83e9 expref: 41 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504900:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30a9b26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83fe expref: 40 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504913:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9afc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f7 expref: 39 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504925:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2c00/0x11620bc3f30a9ab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83e2 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504934:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.504939:0:7753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787273.504960:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504974:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504984:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.504998:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505005:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505011:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505114:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505123:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505131:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787273.505652:0:7753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1787787273.505664:0:7753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417687525193ns, next at 418687521839ns, rc = 0 00010000:00010000:3.0:1787787273.505715:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505725:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505733:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505740:0:7753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505747:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505753:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505775:0:7753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787273.505793:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505806:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505812:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505818:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.505822:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505830:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505840:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787273.505843:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787787273.505848:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505854:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b42 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505871:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505876:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505882:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505887:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787273.505896:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505903:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505913:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787273.505915:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787273.505918:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505923:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787273.505933:0:7753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6cd181d reply state 00000000c806a842 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505942:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.505948:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:3.0:1787787273.505950:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787273.505952:0:7753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787787273.506213:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787273.506221:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.506227:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787273.506230:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.506237:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.506246:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:1.0:1787787273.506249:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787787273.506260:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.506271:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9b49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.506283:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787273.506285:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787273.506287:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787273.506346:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:12397:x1874630484784256:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1733us (1974us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787787273.506356:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 214 00000100:00100000:0.0:1787787273.578325:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787273.578353:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503708800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787273.578425:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787273.578604:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503708800 00000100:00100000:1.0:1787787273.578612:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503708800 00000100:00100000:1.0:1787787273.578696:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787787273.578707:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503708800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787273.578739:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787273.578791:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503708800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787273.578798:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787787273.578851:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503708800:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787787273.579456:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787273.580384:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787273.580401:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503708928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787273.580475:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787273.580650:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503708928 00000100:00100000:0.0:1787787273.580664:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503708928 00000100:00100000:0.0:1787787273.580714:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787787273.580722:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc560450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874630503708928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787273.580740:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787273.580788:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc560450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1874630503708928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787273.580796:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787787273.581458:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503708928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787273.605624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787273.614275:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484784512 00000100:00100000:1.0:1787787273.614364:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484784512 00000100:00100000:1.0:1787787273.614521:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 215 00000100:00100000:1.0:1787787273.614534:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+39:12403:x1874630484784512:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787273.614563:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787273.614587:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0200/0x11620bc3f30a9b50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8405 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.614720:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.614755:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.614768:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.614782:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.614789:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.614795:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787273.615132:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787787273.615324:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615334:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615342:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615377:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615384:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615391:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615404:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787273.615409:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615416:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615429:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:1.0:1787787273.615432:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787273.615437:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615444:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1c00/0x11620bc3f30a9b57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787273.615458:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5b5ee1a reply state 00000000f4ee56fb transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615469:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615474:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:1.0:1787787273.615477:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787787273.615480:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787787273.615508:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0200/0x11620bc3f30a9b50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 42 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615521:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 41 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.615539:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787273.615541:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787273.615544:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0e00, rc 0) 00000100:00100000:1.0:1787787273.615630:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+42:12403:x1874630484784512:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1099us (10020us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787787273.615639:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 215 00000100:00100000:0.0:1787787273.634816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.636192:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484784640 00000100:00100000:2.0:1787787273.636205:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484784640 00000100:00100000:2.0:1787787273.636280:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:2.0:1787787273.636302:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484784640:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787273.636323:0:9030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787273.636347:0:9030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c840c expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787273.636373:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787273.636395:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1787787273.636399:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787273.636409:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 8 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.636428:0:9030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 8 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.636442:0:9030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2e00, rc 0) 00000100:00100000:2.0:1787787273.636514:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484784640:12345-192.168.204.31@tcp:101:bash.0 Request processed in 225us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787273.636522:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:0.0:1787787273.654419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787273.654503:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484784768 00000100:00100000:1.0:1787787273.654513:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484784768 00000100:00100000:1.0:1787787273.654571:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:1.0:1787787273.654582:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:12403:x1874630484784768:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787273.654600:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787273.654620:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8413 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.654658:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 9 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.654667:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787273.654671:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787273.654676:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.654707:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 9 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.654741:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 9 pid: 9030 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787273.654755:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8444:1874630503709056:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787273.654864:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787273.661184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.661465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484784896 00000100:00100000:2.0:1787787273.661474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484784896 00010000:00010000:2.0:1787787273.661528:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 10 pid: 9030 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.661591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:2.0:1787787273.661602:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2391:x1874630484784896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787273.661619:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787273.661831:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 10 pid: 9030 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.661850:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 10 pid: 9030 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.661878:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787273.661883:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787273.661891:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.661901:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.661966:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.661982:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6514:1874630503709184:192.168.204.31@tcp:105: 00000100:00100000:2.0:1787787273.662120:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d4ec5780 going to sleep for 11 seconds 00010000:00010000:1.0:1787787273.662525:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000380efc84/0x11620bc3f30a9b73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c840c expref: 10 pid: 9030 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787273.662541:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8444:1874630503709056:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787273.662565:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.662576:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0200, rc 0) 00000100:00100000:1.0:1787787273.662611:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:12403:x1874630484784768:12345-192.168.204.31@tcp:101:bash.0 Request processed in 8031us (8200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787273.662619:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:2.0:1787787273.682910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.683486:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6514:1874630503709184:192.168.204.31@tcp:105: 00010000:00010000:3.0:1787787273.683579:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787273.683638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484784896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 22038us (22502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787273.684135:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484785152 00000100:00100000:0.0:1787787273.684178:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484785152 00000100:00100000:0.0:1787787273.684235:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:0.0:1787787273.684245:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+42:12403:x1874630484785152:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1787787273.685792:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:0.0:1787787273.686015:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:12403:x1874630484785152:12345-192.168.204.31@tcp:35:bash.0 Request processed in 1770us (3112us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787787273.686024:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:2.0:1787787273.879989:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.880182:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484785280 00000100:00100000:3.0:1787787273.880191:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484785280 00000100:00100000:3.0:1787787273.880258:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 216 00000100:00100000:3.0:1787787273.880272:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+43:12419:x1874630484785280:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787273.880297:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787273.880316:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c841a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.880717:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.880732:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.880747:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787273.880792:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787787273.880796:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787273.880814:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.880843:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c841a expref: 45 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.880864:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c841a expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.880874:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787273.880877:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787273.880888:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3a00, rc 0) 00000100:00100000:3.0:1787787273.880956:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:12419:x1874630484785280:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 690us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.880964:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 216 00000100:00100000:2.0:1787787273.898664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787273.899053:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484785536 00000100:00100000:1.0:1787787273.899074:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484785536 00000100:00100000:1.0:1787787273.899202:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 217 00000100:00100000:1.0:1787787273.899213:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+44:12419:x1874630484785536:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787273.899232:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787273.899253:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1e00/0x11620bc3f30a9b8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8421 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.899403:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9b96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.899417:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.899429:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787273.899758:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787787273.899864:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1e00/0x11620bc3f30a9b8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8421 expref: 47 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.899883:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9b96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8421 expref: 46 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.899892:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787273.899896:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787273.899899:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0000, rc 0) 00000100:00100000:1.0:1787787273.899965:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+46:12419:x1874630484785536:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 754us (1310us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787787273.899973:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 217 00000100:00100000:2.0:1787787273.900894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.901002:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787273.901110:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484785792 00000100:00100000:0.0:1787787273.901118:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484785792 00000100:00100000:0.0:1787787273.901190:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:0.0:1787787273.901321:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484785792:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:0.0:1787787273.901411:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484785792:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 96us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787273.901418:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:3.0:1787787273.901711:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484785664 00000100:00100000:3.0:1787787273.901717:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484785664 00002000:00100000:3.0:1787787273.901745:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff986fc489ad00 x1874630484785664/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:134/0 lens 504/0 e 0 to 0 dl 1787787284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787273.901756:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc489ad00 with x1874630484785664 ext(0->8) 00002000:00010000:3.0:1787787273.901760:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff986fc489ad00 00000100:00100000:3.0:1787787273.901820:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:3.0:1787787273.901829:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484785664:12345-192.168.204.31@tcp:4:bash.0 00000100:00100000:2.0:1787787273.906564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.906608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787273.906674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786048 00000100:00100000:1.0:1787787273.906684:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786048 00000100:00100000:1.0:1787787273.906750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:1.0:1787787273.906760:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+46:2393:x1874630484786048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787273.906778:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787273.906821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9b96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8421 expref: 46 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.906841:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787273.906846:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787273.906906:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+45:2393:x1874630484786048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 148us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787273.906914:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787273.907788:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786176 00000100:00100000:3.0:1787787273.907795:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786176 00000100:00100000:3.0:1787787273.907833:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 218 00000100:00100000:3.0:1787787273.907842:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+45:12419:x1874630484786176:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787273.907862:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787273.907879:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ba4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8428 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787273.907948:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484785664:12345-192.168.204.31@tcp:4:bash.0 Request processed in 6119us (7056us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787787273.907966:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00002000:00100000:0.0:1787787273.907975:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff986fc489ad00 x1874630484785664/t4294967309(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:134/0 lens 504/448 e 0 to 0 dl 1787787284 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787787273.907976:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787787273.907985:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc489ad00 with x1874630484785664 ext(0->8) 00010000:00010000:3.0:1787787273.907990:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.908001:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787273.908023:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00002000:00010000:0.0:1787787273.908056:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff986fc489ad00 00010000:00010000:3.0:1787787273.909180:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9ba4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8428 expref: 48 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.909202:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8428 expref: 47 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.909211:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:3.0:1787787273.909214:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787787273.909217:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2600, rc 0) 00000100:00100000:3.0:1787787273.909267:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:12419:x1874630484786176:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1426us (2659us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1787787273.909275:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 218 00000100:00100000:0.0:1787787273.918458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.918675:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786304 00000100:00100000:2.0:1787787273.918728:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786304 00000100:00100000:2.0:1787787273.918794:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:2.0:1787787273.918805:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2391:x1874630484786304:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1787787273.918850:0:13816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.918872:0:13816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.918881:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787787273.918885:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787273.918890:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.918924:0:13816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 10 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.918938:0:13816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 10 pid: 8444 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.918954:0:13816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13816:1874630503709312:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787273.919080:0:13816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d4ec5780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787273.923966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.924474:0:13816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13816:1874630503709312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787273.924504:0:13816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787273.924587:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786432 00000100:00100000:0.0:1787787273.924595:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786432 00010000:00010000:0.0:1787787273.924637:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 11 pid: 8444 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787273.924674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 98 00000100:00100000:0.0:1787787273.924683:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:2392:x1874630484786432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787273.924698:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787787273.924714:0:6514:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787787273.924717:0:6514:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787787273 00002000:00010000:0.0:1787787273.924720:0:6514:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787787273 00002000:00010000:0.0:1787787273.924721:0:6514:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787787273.924728:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 11 pid: 8444 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787273.924817:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 11 pid: 8444 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787273.924843:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30a9b7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8413 expref: 11 pid: 8444 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787273.924874:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787273.924878:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787273.924883:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787273.924893:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787273.924923:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787273.924986:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484786432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 302us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787273.924994:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 98 00010000:00010000:2.0:1787787273.925411:0:13816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925422:0:13816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925443:0:13816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925451:0:13816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925460:0:13816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925467:0:13816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787273.925472:0:13816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925481:0:13816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925493:0:13816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.925513:0:13816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007e31156/0x11620bc3f30a9bb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.925561:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484786304:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 6758us (7114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787273.925570:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:1.0:1787787273.930015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787273.936907:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786688 00000100:00100000:2.0:1787787273.936922:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786688 00000100:00100000:2.0:1787787273.937046:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:2.0:1787787273.937057:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3665050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+47:12419:x1874630484786688:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:2.0:1787787273.937163:0:6531:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8428 expref: 47 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787273.937357:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787787273.937391:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787787273.937668:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787787273.937707:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.937721:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 51 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.937741:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.937783:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 51 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.937816:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 51 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.937831:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ef8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874630503709440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787273.937928:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787273.941435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.941508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786816 00000100:00100000:3.0:1787787273.941517:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786816 00010000:00010000:3.0:1787787273.941556:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 52 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787273.941598:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 99 00000100:00100000:3.0:1787787273.941607:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:2391:x1874630484786816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787273.941623:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787273.941645:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 52 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.941659:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 52 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.941682:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:3.0:1787787273.941688:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.941697:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.941703:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.941720:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787273.941787:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+52:2391:x1874630484786816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 181us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.941794:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 99 00010000:00010000:2.0:1787787273.943052:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0e00/0x11620bc3f30a9b65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8405 expref: 51 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787273.943447:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ef8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6531:1874630503709440:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787273.943471:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.943480:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787273.943485:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787273.943592:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1787787273.943719:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787787273.943966:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c3ef8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503709568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787787273.944019:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787273.944105:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787273.944450:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503709568 00000100:00100000:3.0:1787787273.944457:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503709568 00000100:00100000:3.0:1787787273.944535:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787787273.944545:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1874630503709568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787273.944632:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1874630503709568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.944638:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787787273.944709:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c3ef8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503709568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787787273.944827:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1787787273.944869:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503709696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787787273.944901:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787273.945136:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787273.945410:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503709696 00000100:00100000:2.0:1787787273.945415:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503709696 00000100:00100000:2.0:1787787273.945441:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787787273.945449:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1874630503709696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787787273.945583:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6531:x1874630503709696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (681us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787787273.945590:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787787273.945684:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6531:1874630503709696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787787273.945721:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787787273.945872:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.945883:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.945890:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.945896:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787273.945900:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.945915:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.945931:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787273.945934:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787787273.945940:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787273.945946:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bc0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787273.946036:0:6531:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787787273.946104:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787787273.946128:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418127989114ns, next at 419127986643ns, rc = 0 00000001:00080000:1.0:1787787273.946135:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787787273.946354:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787273.946357:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787787273.946364:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bab lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8428 expref: 55 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787273.946461:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3665050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:12419:x1874630484786688:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 9406us (16465us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787787273.946470:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000020:00080000:1.0:1787787273.946474:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787787273.949908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.949986:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484786944 00000100:00100000:3.0:1787787273.949996:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484786944 00000100:00100000:3.0:1787787273.950075:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 219 00000100:00100000:3.0:1787787273.950085:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+54:12419:x1874630484786944:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787273.950109:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787273.950379:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9bc7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c842f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.950443:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c842f expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.950456:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c842f expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787273.950475:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787273.950478:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787273.950481:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2800, rc 0) 00000100:00100000:3.0:1787787273.950572:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:12419:x1874630484786944:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 487us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.950579:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 219 00000100:00100000:2.0:1787787273.956403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787273.956486:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484787200 00000100:00100000:3.0:1787787273.956495:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484787200 00000100:00100000:3.0:1787787273.956589:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:3.0:1787787273.956601:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+55:12419:x1874630484787200:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787273.956851:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+56:12419:x1874630484787200:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 252us (458us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787787273.956859:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00010000:00010000:3.0:1787787274.025453:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787274.076565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.077547:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484787328 00000100:00100000:3.0:1787787274.077574:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484787328 00000100:00100000:3.0:1787787274.077688:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 220 00000100:00100000:3.0:1787787274.077698:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+56:12429:x1874630484787328:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1787787274.077770:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077788:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077799:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077812:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077819:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077826:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077899:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077907:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077914:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787274.077961:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077986:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.077993:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078001:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078006:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.078010:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078017:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078031:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787274.078034:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.078039:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078045:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9bce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078068:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078074:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078080:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078091:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.078095:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078101:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078126:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:3.0:1787787274.078128:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.078132:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078185:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9bd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078195:0:7753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078201:0:7753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078207:0:7753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078213:0:7753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.078216:0:7753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078222:0:7753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078241:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.078243:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.078246:0:7753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.078252:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9bdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.078334:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+56:12429:x1874630484787328:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 637us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.078342:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 220 00000100:00100000:1.0:1787787274.109310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.109712:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484787584 00000100:00100000:2.0:1787787274.109722:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484787584 00000100:00100000:2.0:1787787274.109791:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 221 00000100:00100000:2.0:1787787274.109801:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+56:12432:x1874630484787584:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787274.109824:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.109847:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9be3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8436 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.109938:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.109953:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.109963:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.109976:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.109984:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.109991:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110126:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110135:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110182:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787274.110193:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787787274.110270:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110277:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110283:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110289:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.110293:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110301:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110312:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787274.110315:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787274.110320:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110335:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9bea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110349:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110355:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110361:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110365:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.110368:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110374:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110381:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:2.0:1787787274.110383:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787274.110386:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110391:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9bf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110423:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9be3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8436 expref: 59 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110436:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8436 expref: 58 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.110450:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787274.110452:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787274.110455:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3800, rc 0) 00000100:00100000:2.0:1787787274.110522:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:12432:x1874630484787584:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 722us (1223us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787787274.110529:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 221 00000100:00100000:2.0:1787787274.114369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.114461:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484787712 00000100:00100000:3.0:1787787274.114471:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484787712 00000100:00100000:3.0:1787787274.114541:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 222 00000100:00100000:3.0:1787787274.114551:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:12432:x1874630484787712:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:3.0:1787787274.114618:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114634:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114647:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114681:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114689:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114715:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114721:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.114726:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114733:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114745:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.114748:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787274.114753:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.114760:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.114836:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:12432:x1874630484787712:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 286us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.114844:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 222 00000100:00100000:1.0:1787787274.120673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.120775:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484787968 00000100:00100000:2.0:1787787274.120784:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484787968 00000100:00100000:2.0:1787787274.120876:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1787787274.120891:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+58:12432:x1874630484787968:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1787787274.121176:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:12432:x1874630484787968:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 278us (504us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787787274.121185:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1787787274.235240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.235350:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484788224 00000100:00100000:1.0:1787787274.235361:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484788224 00000100:00100000:1.0:1787787274.235441:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 223 00000100:00100000:1.0:1787787274.235451:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+59:12442:x1874630484788224:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787274.235477:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787274.235480:0:13825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787787274.235519:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3a00/0x11620bc3f30a9b88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c841a expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.235539:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:1.0:1787787274.235545:0:13825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787274.235714:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1600/0x11620bc3f30a9c0d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c843d expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.235822:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30a9c14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.235836:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30a9c14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.235846:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30a9c14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787274.235856:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787787274.235960:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1600/0x11620bc3f30a9c0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c843d expref: 61 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.235977:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30a9c14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c843d expref: 60 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.236002:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:1.0:1787787274.236005:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787274.236008:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0400, rc 0) 00000100:00100000:1.0:1787787274.236091:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:12442:x1874630484788224:12345-192.168.204.31@tcp:101:bash.0 Request processed in 641us (862us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787787274.236099:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 223 00000100:00100000:1.0:1787787274.241232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.241289:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.241344:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484788480 00000100:00100000:2.0:1787787274.241347:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484788352 00000100:00100000:3.0:1787787274.241354:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484788480 00000100:00100000:2.0:1787787274.241354:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484788352 00000100:00100000:3.0:1787787274.241449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1787787274.241449:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 224 00000100:00100000:3.0:1787787274.241464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:2391:x1874630484788480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787787274.241465:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:12442:x1874630484788352:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787274.241484:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787274.241491:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787274.241512:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30a9c14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c843d expref: 61 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.241516:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9c22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8444 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.241557:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.241563:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787274.241621:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+61:2391:x1874630484788480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 160us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.241628:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00010000:00010000:2.0:1787787274.241637:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.241662:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.241673:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.241778:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9c22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 61 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.241792:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.241799:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787274.241801:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787274.241804:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787274.241889:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:12442:x1874630484788352:12345-192.168.204.31@tcp:101:bash.0 Request processed in 430us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.241895:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 224 00000100:00100000:1.0:1787787274.245670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.245749:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484788736 00000100:00100000:3.0:1787787274.245760:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484788736 00000100:00100000:3.0:1787787274.245819:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 225 00000100:00100000:3.0:1787787274.245829:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+60:12442:x1874630484788736:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:3.0:1787787274.245883:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787274.245912:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30a9bf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8436 expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.245931:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.245936:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787274.246472:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.246490:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.246500:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787274.246539:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1787787274.246561:0:6528:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092aca62e reply state 000000007cc79998 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.246584:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.246590:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.246592:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787274.246594:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787274.246690:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:12442:x1874630484788736:12345-192.168.204.31@tcp:36:bash.0 Request processed in 862us (1030us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787787274.246699:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 225 00000020:00080000:3.0:1787787274.246704:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787787274.250468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.250595:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484788864 00000100:00100000:0.0:1787787274.250616:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484788864 00000100:00100000:0.0:1787787274.250677:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 226 00000100:00100000:0.0:1787787274.250690:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+62:12442:x1874630484788864:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787274.250715:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787274.250738:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9c37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c844b expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.250836:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.250854:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.250868:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787274.250925:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787787274.250930:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787274.250952:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.250979:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30a9c37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 64 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.251000:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 63 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.251008:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787274.251011:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787274.251014:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:0.0:1787787274.251091:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:12442:x1874630484788864:12345-192.168.204.31@tcp:101:bash.0 Request processed in 403us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.251098:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 226 00000100:00100000:2.0:1787787274.255438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.255518:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484789120 00000100:00100000:3.0:1787787274.255529:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484789120 00000100:00100000:3.0:1787787274.255591:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1787787274.255601:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+63:12442:x1874630484789120:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1787787274.256294:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c1326940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12442:x1874630484789120:12345-192.168.204.31@tcp:35:bash.0 Request processed in 693us (866us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787787274.256304:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:1.0:1787787274.372640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.373033:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484789248 00000100:00100000:0.0:1787787274.373045:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484789248 00000100:00100000:0.0:1787787274.373125:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 227 00000100:00100000:0.0:1787787274.373407:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+64:12448:x1874630484789248:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787274.373432:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787274.373455:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30a9c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8452 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.373524:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15800/0x11620bc3f30a9c4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.373559:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15800/0x11620bc3f30a9c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.373571:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15800/0x11620bc3f30a9c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787274.373623:0:13672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787787274.373691:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787274.373714:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15800/0x11620bc3f30a9c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.373739:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30a9c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8452 expref: 66 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.373759:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15800/0x11620bc3f30a9c4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8452 expref: 65 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.373768:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787274.373772:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787274.373775:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15800, rc 0) 00000100:00100000:0.0:1787787274.373847:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484789248:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 443us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.373855:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 227 00000100:00100000:0.0:1787787274.383344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.389124:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484789376 00000100:00100000:3.0:1787787274.389153:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484789376 00000100:00100000:2.0:1787787274.394631:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 228 00000100:00100000:2.0:1787787274.394648:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484789376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787274.394671:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.394693:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9c53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8459 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394771:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394812:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394825:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394837:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394845:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394852:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394938:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394948:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.394955:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787274.395000:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787787274.395004:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787274.395023:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395034:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395066:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395072:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395078:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395084:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.395088:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395096:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395108:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787274.395111:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787274.395116:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395122:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395136:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395336:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395342:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395354:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.395357:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395364:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395373:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:2.0:1787787274.395375:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787274.395379:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395384:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395413:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9c53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8459 expref: 67 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395427:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8459 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.395434:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787274.395436:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787274.395438:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2800, rc 0) 00000100:00100000:2.0:1787787274.395516:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12448:x1874630484789376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 872us (12182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.395524:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 228 00000100:00100000:3.0:1787787274.404854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.405221:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484789504 00000100:00100000:0.0:1787787274.405232:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484789504 00000100:00100000:0.0:1787787274.405299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787274.405310:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:2393:x1874630484789504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787274.405341:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.405370:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2800/0x11620bc3f30a9c68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8459 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.405391:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787274.405396:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787274.405515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:2393:x1874630484789504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 206us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.405523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:1.0:1787787274.419758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.420822:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484789760 00000100:00100000:2.0:1787787274.420854:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484789760 00000100:00100000:2.0:1787787274.421132:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 229 00000100:00100000:2.0:1787787274.421307:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484789760:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787274.421330:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.421351:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9c6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8460 expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.421463:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.421478:0:13825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 66 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.421486:0:13825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.421520:0:13825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 66 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.421535:0:13825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 66 pid: 7753 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787274.421548:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503709824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787274.421808:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787274.426352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.426691:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503709824:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787274.426720:0:13825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.427374:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484789888 00000100:00100000:1.0:1787787274.427382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484789888 00010000:00010000:1.0:1787787274.427420:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 67 pid: 7753 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.427458:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 100 00000100:00100000:1.0:1787787274.427466:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c74f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:2391:x1874630484789888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787274.427480:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787274.427486:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 67 pid: 7753 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.427500:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 67 pid: 7753 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.427521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30a9c3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c844b expref: 67 pid: 7753 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.427550:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:1.0:1787787274.427556:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.427565:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.427573:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.427599:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787274.427720:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c74f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:2391:x1874630484789888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 253us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.427727:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 100 00010000:00010000:2.0:1787787274.429562:0:13825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.429592:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787274.429617:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787787274.430044:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2600/0x11620bc3f30a9c6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 67 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.430078:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 66 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.430087:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787274.430090:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787274.430093:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2400, rc 0) 00000100:00100000:2.0:1787787274.430514:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12448:x1874630484789760:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 9211us (10765us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787787274.430523:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 229 00000100:00100000:3.0:1787787274.438577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.438714:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484790144 00000100:00100000:0.0:1787787274.438724:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484790144 00000100:00100000:0.0:1787787274.438795:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:0.0:1787787274.438806:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12448:x1874630484790144:12345-192.168.204.31@tcp:103:lfs.0 00010000:00010000:0.0:1787787274.438822:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.438851:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2800/0x11620bc3f30a9bc7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c842f expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.438874:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787274.438880:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787274.438934:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484790144:12345-192.168.204.31@tcp:103:lfs.0 Request processed in 131us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.438942:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:0.0:1787787274.442350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.442455:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484790272 00000100:00100000:3.0:1787787274.442465:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484790272 00000100:00100000:3.0:1787787274.442531:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 230 00000100:00100000:3.0:1787787274.442541:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484790272:12345-192.168.204.31@tcp:58:lfs.0 00010000:00010000:3.0:1787787274.442856:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.442874:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.442885:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787274.442985:0:13672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787787274.443489:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484790272:12345-192.168.204.31@tcp:58:lfs.0 Request processed in 947us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.443499:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 230 00000100:00100000:3.0:1787787274.449215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.449344:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484790400 00000100:00100000:2.0:1787787274.449354:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484790400 00000100:00100000:2.0:1787787274.449427:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 231 00000100:00100000:2.0:1787787274.449438:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+65:12448:x1874630484790400:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787274.449458:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.449478:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8467 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.449535:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.449565:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.449582:0:6528:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.449595:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.449610:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787274.449613:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787274.449617:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.449624:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787274.449702:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12448:x1874630484790400:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 259us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.449710:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 231 00000040:00080000:0.0:1787787274.473536:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787274.473547:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787274.473571:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787787274.473595:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787274.473760:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503709952:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787274.474048:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b96b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787274.481580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.481701:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503709952:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787274.482092:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484790528 00000100:00100000:3.0:1787787274.482112:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484790528 00000100:00100000:3.0:1787787274.482398:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 232 00000100:00100000:3.0:1787787274.482410:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12449:x1874630484790528:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787787274.482444:0:7753:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787787274.482562:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12449:x1874630484790528:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 153us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.482570:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 232 00000100:00100000:2.0:1787787274.490041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.490193:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484790656 00000100:00100000:1.0:1787787274.490206:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484790656 00000100:00100000:1.0:1787787274.490262:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:1.0:1787787274.490273:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12449:x1874630484790656:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787787274.490354:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490373:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490386:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490403:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490427:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490435:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490461:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490471:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490479:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787274.490533:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787787274.490537:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787274.490551:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490563:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490569:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490576:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490582:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787274.490586:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490603:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490617:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:1.0:1787787274.490620:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787274.490638:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490645:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9c92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490660:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490666:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490671:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490676:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787274.490678:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490684:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490691:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787274.490694:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787274.490696:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490713:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9c99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490727:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490733:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490739:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490744:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787274.490747:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490753:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490956:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:1.0:1787787274.490959:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787274.490963:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.490970:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.491281:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12449:x1874630484790656:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 Request processed in 1007us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.491290:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:0.0:1787787274.512305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.512514:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484790912 00000100:00100000:1.0:1787787274.512526:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484790912 00000100:00100000:1.0:1787787274.512591:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:1.0:1787787274.512601:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+66:12449:x1874630484790912:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787274.512632:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787274.512655:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c846e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512772:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512789:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512801:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787274.512812:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787787274.512889:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512897:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512903:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512909:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787274.512913:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512920:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512948:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:1.0:1787787274.512951:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787787274.512956:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.512962:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9cae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.513003:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c846e expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.513014:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:1.0:1787787274.513016:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787274.513020:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9ca7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c846e expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.513031:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0800, rc 0) 00000100:00100000:1.0:1787787274.513413:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:12449:x1874630484790912:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 811us (1114us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1787787274.513422:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:2.0:1787787274.521829:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.523992:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484791040 00000100:00100000:3.0:1787787274.524007:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484791040 00000100:00100000:3.0:1787787274.525967:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 235 00000100:00100000:3.0:1787787274.525992:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:12449:x1874630484791040:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787787274.526031:0:7753:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787787274.526233:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:12449:x1874630484791040:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 252us (4414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.526241:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 235 00000100:00100000:2.0:1787787274.537959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.543911:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484791296 00000100:00100000:0.0:1787787274.543934:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484791296 00000100:00100000:0.0:1787787274.544024:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 236 00000100:00100000:0.0:1787787274.544036:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:12449:x1874630484791296:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787274.544716:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787274.544721:0:13672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787787274.544753:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15800/0x11620bc3f30a9c4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8452 expref: 67 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.546916:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:0.0:1787787274.546925:0:13672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787274.546952:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9cbc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8475 expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787274.549780:0:13672:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787787274.549972:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30a9cc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.549995:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30a9cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.550008:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30a9cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.551967:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9cbc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8475 expref: 69 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.552003:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30a9cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8475 expref: 68 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.552013:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:0.0:1787787274.552017:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787274.552021:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15400, rc 0) 00000100:00100000:0.0:1787787274.553610:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:12449:x1874630484791296:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 9564us (15649us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787787274.553632:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 236 00000100:00100000:0.0:1787787274.576894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.577237:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484791552 00000100:00100000:2.0:1787787274.577248:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484791552 00000100:00100000:2.0:1787787274.577316:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 237 00000100:00100000:2.0:1787787274.577326:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:12449:x1874630484791552:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787274.577392:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787274.577437:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30a9cc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8475 expref: 68 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577460:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d4ceca00) 00010000:00010000:2.0:1787787274.577472:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787274.577495:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577526:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577537:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577552:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577559:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577566:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577612:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577620:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577638:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577645:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.577655:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577663:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577672:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:2.0:1787787274.577675:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787274.577679:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577686:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30a9cd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577696:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577702:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577707:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577713:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.577715:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577721:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577728:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x90fc8364 (ffff986fc3a1da00) 00010000:00010000:2.0:1787787274.577730:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787274.577740:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.577746:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cd8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x90fc8364 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787274.580016:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:12449:x1874630484791552:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 2680us (3124us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787274.580028:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 237 00000100:00100000:2.0:1787787274.584722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.585411:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484791680 00000100:00100000:1.0:1787787274.585424:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484791680 00000100:00100000:1.0:1787787274.585485:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 238 00000100:00100000:1.0:1787787274.585496:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+67:12449:x1874630484791680:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787274.585517:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787274.585543:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9cdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c847c expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.585618:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.585632:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.585644:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.585771:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0800/0x11620bc3f30a9cdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 69 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.585792:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 68 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.585802:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787274.585805:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787274.585809:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1400, rc 0) 00000100:00100000:1.0:1787787274.585872:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:12449:x1874630484791680:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 377us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.585879:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 238 00000100:00100000:0.0:1787787274.590290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.590441:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484791936 00000100:00100000:1.0:1787787274.590452:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484791936 00000100:00100000:1.0:1787787274.590518:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 239 00000100:00100000:1.0:1787787274.590529:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+68:12449:x1874630484791936:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787274.590616:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.590653:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.590666:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787274.590878:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787787274.590891:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418772751672ns, next at 419772748070ns, rc = 0 00000004:00010000:1.0:1787787274.590954:0:6529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003610a534 reply state 00000000193d08e0 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.590969:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.590977:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:1.0:1787787274.590981:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787787274.590985:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787274.595461:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+70:12449:x1874630484791936:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 4920us (5168us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787787274.595476:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 239 00000100:00100000:0.0:1787787274.601462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.601628:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484792064 00000100:00100000:2.0:1787787274.601640:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484792064 00000100:00100000:2.0:1787787274.601711:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 240 00000100:00100000:2.0:1787787274.601723:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+70:12449:x1874630484792064:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787274.601747:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.601771:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8483 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.601833:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 71 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.601849:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 71 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.601868:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:2.0:1787787274.601872:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787274.601875:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787274.601936:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+71:12449:x1874630484792064:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 216us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.601961:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 240 00000100:00100000:2.0:1787787274.609597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.609718:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484792192 00000100:00100000:1.0:1787787274.609731:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484792192 00000100:00100000:1.0:1787787274.609825:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:1.0:1787787274.609836:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2391:x1874630484792192:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787787274.610389:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2391:x1874630484792192:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 553us (806us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787787274.610398:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00080000:0.0:1787787274.611559:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787274.616838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.616915:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484792448 00000100:00100000:2.0:1787787274.616924:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484792448 00000100:00100000:2.0:1787787274.616990:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787274.617000:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+71:12449:x1874630484792448:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787274.617637:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+72:12449:x1874630484792448:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 633us (806us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787787274.617647:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787274.634576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.635386:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484792704 00000100:00100000:1.0:1787787274.635412:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484792704 00000100:00100000:1.0:1787787274.635482:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 241 00000100:00100000:1.0:1787787274.635493:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+72:12449:x1874630484792704:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787787274.636925:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+72:12449:x1874630484792704:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 1425us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.636949:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 241 00000100:00100000:2.0:1787787274.664474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.664573:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484792832 00000100:00100000:0.0:1787787274.664582:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484792832 00000100:00100000:0.0:1787787274.664641:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 242 00000100:00100000:0.0:1787787274.664650:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+72:12449:x1874630484792832:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787274.664670:0:13672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787274.664706:0:13672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9cfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c848a expref: -99 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.664778:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.664792:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.664803:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787274.664858:0:13672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787274.664882:0:13672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.664908:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9cfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c848a expref: 74 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.664926:0:13672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c848a expref: 73 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.664934:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787274.664937:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787787274.664941:0:13672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14800, rc 0) 00000100:00100000:0.0:1787787274.665001:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+73:12449:x1874630484792832:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 352us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.665008:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 242 00000100:00100000:0.0:1787787274.671263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.671602:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484792960 00000100:00100000:2.0:1787787274.671612:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484792960 00000100:00100000:2.0:1787787274.671679:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:2.0:1787787274.671689:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+10:2392:x1874630484792960:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787274.671707:0:9030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.671728:0:9030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8491 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787274.671754:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f780a, blocks: 0x0 00010000:00010000:2.0:1787787274.671774:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1787787274.671779:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787274.671788:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 11 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.671805:0:9030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 11 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.671840:0:9030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3200, rc 0) 00000100:00100000:2.0:1787787274.671897:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:2392:x1874630484792960:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 209us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.671905:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:2.0:1787787274.675966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.677399:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793216 00000100:00100000:0.0:1787787274.677429:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793216 00000100:00100000:0.0:1787787274.677502:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 243 00000100:00100000:0.0:1787787274.677512:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+73:12449:x1874630484793216:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787274.677627:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+73:12449:x1874630484793216:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 116us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.677634:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 243 00000100:00100000:1.0:1787787274.680735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.680834:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793344 00000100:00100000:2.0:1787787274.680844:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793344 00000100:00100000:2.0:1787787274.680903:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:2.0:1787787274.680914:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+11:12449:x1874630484793344:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787274.680932:0:13816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787274.680951:0:13816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8498 expref: -99 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.680982:0:13816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 12 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.680992:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787274.680996:0:13816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787274.681001:0:13816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 12 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.681036:0:13816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 12 pid: 9030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.681082:0:13816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 12 pid: 9030 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787274.681106:0:13816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13816:1874630503710080:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787274.681574:0:13816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.688726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.688816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793472 00000100:00100000:0.0:1787787274.688825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793472 00010000:00010000:0.0:1787787274.688866:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 13 pid: 9030 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.688915:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 101 00000100:00100000:0.0:1787787274.688925:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:2391:x1874630484793472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787274.688941:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.688961:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 13 pid: 9030 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.688987:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 13 pid: 9030 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.689009:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787274.689014:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787274.689021:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 13 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.689032:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 13 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.689094:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 13 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.689119:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6514:1874630503710208:192.168.204.31@tcp:105: 00000100:00100000:0.0:1787787274.689239:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b969c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787787274.694975:0:13816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30a9d09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8491 expref: 13 pid: 9030 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.695004:0:13816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13816:1874630503710080:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787274.695039:0:13816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 12 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.695070:0:13816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2600, rc 0) 00000100:00100000:3.0:1787787274.695594:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:12449:x1874630484793344:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 14680us (14866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.695604:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:0.0:1787787274.703374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.703732:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793600 00000100:00100000:2.0:1787787274.703742:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793600 00002000:00100000:2.0:1787787274.703797:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff986fc36ef480 x1874630484793600/t0(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:135/0 lens 504/0 e 0 to 0 dl 1787787285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787274.703809:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc36ef480 with x1874630484793600 ext(0->12) 00002000:00010000:2.0:1787787274.703815:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc36ef480 00000100:00100000:2.0:1787787274.703844:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787274.703854:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+12:2392:x1874630484793600:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787787274.704817:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6514:1874630503710208:192.168.204.31@tcp:105: 00010000:00010000:3.0:1787787274.704844:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787274.704899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+14:2391:x1874630484793472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 15975us (16183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.704909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 101 00000100:00100000:2.0:1787787274.706782:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:2392:x1874630484793600:12345-192.168.204.31@tcp:4:lhsmtool_posix.0 Request processed in 2918us (3406us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787787274.706796:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00002000:00100000:2.0:1787787274.706809:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff986fc36ef480 x1874630484793600/t4294967321(0) o4->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:135/0 lens 504/448 e 0 to 0 dl 1787787285 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787274.706820:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc36ef480 with x1874630484793600 ext(0->12) 00002000:00010000:2.0:1787787274.706827:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc36ef480 00000100:00100000:0.0:1787787274.716092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.716316:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793728 00000100:00100000:3.0:1787787274.716327:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793728 00000100:00100000:3.0:1787787274.716388:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 244 00000100:00100000:3.0:1787787274.716397:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+73:12449:x1874630484793728:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787787274.718895:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1787787274.718912:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787787274.718952:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787787274.718970:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff986fc41126c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787787274.718976:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc29aed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff986fc4112e40 00000020:00080000:0.0:1787787274.718979:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc29ae300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870c81eb800 00000004:00080000:0.0:1787787274.719006:0:6506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787787274.719033:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870c12edcc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787787274.719036:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3518100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870c12edb40 00000020:00080000:0.0:1787787274.719039:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3518900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff986fc434f400 00000020:00080000:0.0:1787787274.719061:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1787787274.719256:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787274.719291:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503710336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787787274.719367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787274.719727:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503710592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787787274.719756:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787274.719797:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503710336 00000100:00100000:1.0:1787787274.719803:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503710336 00000100:00100000:1.0:1787787274.719848:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503710592 00000100:00100000:1.0:1787787274.719851:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503710592 00000100:00100000:1.0:1787787274.719872:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787274.719879:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1874630503710336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787787274.719905:0:9030:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1787787274.719937:0:9030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f7809, atime: 0x0, ctime: 0x6a8f7809, blocks: 0x8 00010000:00010000:1.0:1787787274.719944:0:9030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.719960:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1787787274.719964:0:9030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787274.719970:0:9030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.719983:0:9030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.720008:0:9030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.720015:0:9030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.720031:0:9030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787787274.720176:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787274.720186:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503710464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787787274.720227:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787274.720273:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503710464 00000100:00100000:0.0:1787787274.720276:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503710464 00000100:00100000:0.0:1787787274.720294:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787274.720307:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1874630503710592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787787274.720401:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787787274.720405:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787787274 00002000:00010000:0.0:1787787274.720407:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787787274.720408:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787787274 -> 1787787274 00002000:00010000:0.0:1787787274.720410:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787787274.720449:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3655:x1874630503710592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (691us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787787274.720457:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787274.720472:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787787274.720478:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503710464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787787274.720489:0:8443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1787787274.720500:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720515:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 12 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720523:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787787274.720526:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787274.720530:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720557:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 12 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720571:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 12 pid: 8441 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.720589:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8443:1874630503710720:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787274.720642:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b969c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787787274.720655:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787274.720659:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787787274.720679:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787274.720684:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720692:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787274.720696:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720706:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720722:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720730:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a1e9e82/0x11620bc3f30a9d17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.720749:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787274.720750:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787274.720752:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787787274.720790:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc43f9e00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787787274.720803:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503710592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787787274.721490:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3654:x1874630503710336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1608us (2120us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787787274.721499:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1787787274.721727:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721750:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721757:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721763:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.721767:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721775:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721787:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9870d0e3ee00) 00010000:00010000:3.0:1787787274.721790:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.721794:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721800:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30a9a15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721823:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721829:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721835:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721840:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.721849:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721855:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721864:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff986fc2a19000) 00010000:00010000:3.0:1787787274.721866:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.721869:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721874:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9abd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721892:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721898:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721903:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721909:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.721911:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721917:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721923:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:3.0:1787787274.721926:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.721934:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721940:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9b3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721952:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721957:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721962:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721966:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.721969:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721975:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721983:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19b00) 00010000:00010000:3.0:1787787274.721985:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.721988:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.721993:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0c00/0x11620bc3f30a9b5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722021:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722037:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722042:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722058:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.722061:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722068:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722077:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.722079:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.722082:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722087:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9c30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722101:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722117:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722123:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722128:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.722278:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722285:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722293:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:3.0:1787787274.722295:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787787274.722298:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.722303:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1000/0x11620bc3f30a9ced lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787787274.722320:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787787274.722373:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787787274.722481:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12449:x1874630484793728:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 Request processed in 6083us (6397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.722489:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 244 00000004:00080000:2.0:1787787274.722721:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff987101f79e00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787787274.722728:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503710336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787787274.731850:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.731944:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793856 00000100:00100000:1.0:1787787274.731955:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793856 00000100:00100000:1.0:1787787274.732023:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:1.0:1787787274.732033:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+13:2391:x1874630484793856:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787787274.738614:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8443:1874630503710720:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787274.738647:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787274.742016:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1787787274.742029:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1787787274.742263:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484793856:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 Request processed in 10226us (10418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.742275:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:0.0:1787787274.748117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.748964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484793984 00000100:00100000:1.0:1787787274.748976:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484793984 00010000:00010000:1.0:1787787274.749024:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 8 pid: 8441 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.749106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 102 00000100:00100000:1.0:1787787274.749117:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484793984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787274.749133:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787274.749178:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 8 pid: 8441 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.749195:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 8 pid: 8441 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.749230:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30a9acb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83f0 expref: 8 pid: 8441 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.749248:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787274.749252:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787274.749258:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.749268:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.749296:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787274.749369:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484793984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 254us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.749377:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 102 00010000:00010000:2.0:1787787274.749638:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.749649:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.749659:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.749666:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.749689:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787787274.749870:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503710464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29391us (29641us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787787274.749878:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787787274.749964:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787787274.749970:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1787787274.749991:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff986fc43f9e00, transno 4294967322 00000100:00100000:3.0:1787787274.750013:0:3653:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff986fc43fb840 x1874630503710464/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787787290 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787787274.750025:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc43fb840/2, rc 0, transno 4294967323 00000100:00100000:3.0:1787787274.750030:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503710464:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787787274.750193:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787274.750200:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.750218:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787274.750223:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.750234:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.750247:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.750255:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30a9d1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.750273:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787274.750274:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787274.750276:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787274.754625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.754714:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484794240 00000100:00100000:0.0:1787787274.754723:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484794240 00000100:00100000:0.0:1787787274.754779:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 245 00000100:00100000:0.0:1787787274.754789:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12449:x1874630484794240:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787274.754841:0:13672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.754868:0:13672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c848a expref: 21 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.754888:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787274.754892:0:13672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787274.754919:0:13672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.754933:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.754943:0:13672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787274.755073:0:13672:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003038ab3f reply state 0000000086bac9dd transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.755085:0:13672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.755091:0:13672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787274.755118:0:13672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787274.755121:0:13672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787274.755570:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:12449:x1874630484794240:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 780us (952us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787787274.755577:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 245 00000100:00100000:0.0:1787787274.763399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.763547:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484794368 00000100:00100000:1.0:1787787274.763557:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484794368 00000100:00100000:1.0:1787787274.763657:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:1.0:1787787274.763668:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484794368:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787787274.763819:0:9030:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787787274.763823:0:9030:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787787274 -> 1787787274 00002000:00010000:1.0:1787787274.763825:0:9030:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787787274 00002000:00010000:1.0:1787787274.763841:0:9030:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787787274 -> 1787787274 00002000:00010000:1.0:1787787274.763843:0:9030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787787274.763909:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484794368:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 242us (520us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787787274.763918:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:0.0:1787787274.768651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.768739:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484794624 00000100:00100000:2.0:1787787274.768750:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484794624 00000100:00100000:2.0:1787787274.768811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 246 00000100:00100000:2.0:1787787274.768837:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:12449:x1874630484794624:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787787274.768912:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.768930:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 22 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.768940:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.768983:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 22 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.768996:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 22 pid: 13825 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787274.769011:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503710848:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787274.769117:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.772806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.772892:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484794752 00000100:00100000:3.0:1787787274.772916:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484794752 00010000:00010000:3.0:1787787274.772954:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 23 pid: 13825 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.773004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 103 00000100:00100000:3.0:1787787274.773014:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2391:x1874630484794752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787274.773029:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787274.773036:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 23 pid: 13825 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.773061:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 23 pid: 13825 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.773086:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:3.0:1787787274.773092:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.773113:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.773121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.773369:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787274.773414:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+23:2391:x1874630484794752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 401us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.773422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 103 00010000:00010000:0.0:1787787274.773810:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1400/0x11620bc3f30a9ce6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c847c expref: 22 pid: 13825 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.773829:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6528:1874630503710848:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787274.773850:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773860:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773866:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773905:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773912:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773919:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773924:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787274.773928:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773936:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773956:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787274.773958:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787787274.773962:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.773968:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2000/0x11620bc3f30a9d2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.774021:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12449:x1874630484794624:12345-192.168.204.31@tcp:55:lhsmtool_posix.0 Request processed in 5186us (5380us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787787274.774030:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 246 00000100:00100000:3.0:1787787274.781267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.781352:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484794880 00000100:00100000:1.0:1787787274.781363:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484794880 00000100:00100000:1.0:1787787274.781424:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:1.0:1787787274.781434:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2391:x1874630484794880:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787787274.781485:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.781505:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.781515:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787274.781519:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787274.781525:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.781561:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 8 pid: 13816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.781575:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 8 pid: 13816 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.781589:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8441:1874630503710976:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787274.781685:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc4112780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.785489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.785557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484795008 00000100:00100000:0.0:1787787274.785566:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484795008 00010000:00010000:0.0:1787787274.785604:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 9 pid: 13816 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.785642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 104 00000100:00100000:0.0:1787787274.785651:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484795008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787274.785665:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.785686:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 9 pid: 13816 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.785699:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 9 pid: 13816 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.785722:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787274.785726:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787274.785745:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.785755:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.785775:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787274.785835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+9:2392:x1874630484795008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 184us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.785843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 104 00010000:00010000:1.0:1787787274.786394:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30a9d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8498 expref: 8 pid: 13816 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.786410:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8441:1874630503710976:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787274.786430:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786440:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786447:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786467:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786475:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786483:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786490:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787274.786494:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786516:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786530:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.786538:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000072b9de8/0x11620bc3f30a9d33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.786583:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484794880:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 Request processed in 5152us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.786589:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:2.0:1787787274.789610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.789719:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484795264 00000100:00100000:3.0:1787787274.789741:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484795264 00000100:00100000:3.0:1787787274.789956:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 247 00000100:00100000:3.0:1787787274.789968:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:12449:x1874630484795264:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787787274.790070:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.790086:0:13825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.790108:0:13825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.790176:0:13825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.790191:0:13825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 21 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.790206:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503711104:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787274.790416:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.793705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.793782:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484795392 00000100:00100000:1.0:1787787274.793792:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484795392 00010000:00010000:1.0:1787787274.793833:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 22 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.793873:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 105 00000100:00100000:1.0:1787787274.793881:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:2392:x1874630484795392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787274.793895:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787274.793902:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 22 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.793915:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 22 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.793953:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:1.0:1787787274.793959:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.793979:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.793988:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.793996:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787274.794014:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787274.794081:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:2392:x1874630484795392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 200us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.794090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 105 00010000:00010000:3.0:1787787274.794423:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30a9c29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8444 expref: 21 pid: 6529 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.794440:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503711104:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787274.794461:0:13825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794471:0:13825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794484:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794662:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794673:0:13825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794681:0:13825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794706:0:13825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.794719:0:13825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 21 pid: 6528 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.794731:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503711232:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787274.795023:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.799871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.799962:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503711232:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787274.799970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484795520 00000100:00100000:0.0:1787787274.799978:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484795520 00010000:00010000:3.0:1787787274.800004:0:13825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800018:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 22 pid: 6528 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.800108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 106 00000100:00100000:0.0:1787787274.800118:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c74f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:2392:x1874630484795520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787274.800133:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.800178:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 22 pid: 6528 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800190:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 22 pid: 6528 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800216:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30a9cf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8483 expref: 22 pid: 6528 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800233:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787274.800254:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800263:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800271:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.800296:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787274.800345:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c74f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:2392:x1874630484795520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.800352:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 106 00010000:00010000:3.0:1787787274.800569:0:13825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.800576:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787274.800700:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1787787274.801716:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787787274.802842:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787787274.802947:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13825:1874630503711360:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787787274.803094:0:13825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787274.803189:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503711360 00000100:00100000:0.0:1787787274.803195:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503711360 00000100:00100000:0.0:1787787274.803246:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787787274.803255:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13825:x1874630503711360:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787787274.803314:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787274.803331:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13825:x1874630503711360:12345-0@lo:1000:mdt00_005.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.803338:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787787274.803351:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13825:1874630503711360:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1787787274.803589:0:13825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787787274.803628:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13825:1874630503711488:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787787274.803654:0:13825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787274.803762:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787274.803845:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503711488 00000100:00100000:3.0:1787787274.803849:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503711488 00000100:00100000:3.0:1787787274.803879:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787274.803885:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13825:x1874630503711488:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787787274.804091:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13825:x1874630503711488:12345-0@lo:1000:mdt00_005.0 Request processed in 206us (436us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787787274.804099:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787787274.804347:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13825:1874630503711488:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1787787274.804378:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804388:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804396:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804530:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.804535:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804543:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804559:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:2.0:1787787274.804562:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787274.804567:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804574:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3600/0x11620bc3f30a9d41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804595:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804609:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804616:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804621:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787274.804624:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804629:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804636:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787274.804639:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787274.804645:0:13825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804655:0:13825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804727:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787274.804809:0:13825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787274.804823:0:13825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503711616:192.168.204.31@tcp:105: 00000100:00100000:2.0:1787787274.804936:0:13825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.808211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.808496:0:13825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13825:1874630503711616:192.168.204.31@tcp:105: 00010000:00010000:0.0:1787787274.808523:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808534:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2600/0x11620bc3f30a9c84 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808569:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808601:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808613:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808623:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808629:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.808630:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484795648 00010000:00010000:0.0:1787787274.808635:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.808637:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484795648 00010000:00010000:0.0:1787787274.808640:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787274.808644:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808651:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808661:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787274.808663:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787274.808667:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808673:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30a9d48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808682:0:13825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.808695:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00010000:00010000:0.0:1787787274.808695:0:13825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808701:0:13825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.808704:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12448:x1874630484795648:12345-192.168.204.31@tcp:49:lfs.0 00010000:00010000:0.0:1787787274.808706:0:13825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787274.808709:0:13825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808714:0:13825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808721:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787274.808723:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787274.808725:0:13825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.808730:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2000/0x11620bc3f30a9d3a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.808881:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12449:x1874630484795264:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 18914us (19278us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787787274.808890:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 247 00000020:00080000:0.0:1787787274.808895:0:13825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787787274.809010:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787274.809014:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787274.809993:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787787274.810008:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787787274.810134:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:12448:x1874630484795648:12345-192.168.204.31@tcp:49:lfs.0 Request processed in 1428us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.810159:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:1.0:1787787274.814384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787274.814456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787274.814577:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484795904 00000100:00100000:2.0:1787787274.814587:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484795904 00000100:00100000:2.0:1787787274.814648:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 248 00000100:00100000:2.0:1787787274.814659:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+24:12448:x1874630484795904:12345-192.168.204.31@tcp:58:lfs.0 00000100:00100000:3.0:1787787274.814840:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484796160 00000100:00100000:3.0:1787787274.814845:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484796160 00000040:00080000:2.0:1787787274.814855:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787787274.814880:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:3.0:1787787274.814887:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3667050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12449:x1874630484796160:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787787274.814930:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+25:12448:x1874630484795904:12345-192.168.204.31@tcp:58:lfs.0 Request processed in 274us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.814938:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 248 00000004:00080000:3.0:1787787274.816056:0:6530:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787274.816097:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1787787274.816205:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.816299:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.816312:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.816322:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.816328:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.816351:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.816381:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787274.816404:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787274.816412:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.816419:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787274.816429:0:10345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.816439:0:10345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.816453:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787274.816456:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787787274.816462:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.816469:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3400/0x11620bc3f30a9d4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.816483:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787274.816485:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787274.816487:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787274.816746:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3667050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+26:12449:x1874630484796160:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 1855us (2285us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787787274.816821:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00000020:00080000:3.0:1787787274.816826:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787787274.848704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.848935:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484796288 00000100:00100000:3.0:1787787274.848946:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484796288 00000100:00100000:3.0:1787787274.849022:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 249 00000100:00100000:3.0:1787787274.849032:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+26:12451:x1874630484796288:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787274.849072:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787274.849092:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c849f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849290:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849305:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849320:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849464:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849474:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849490:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849677:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849689:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 27 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849697:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849732:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 27 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.849747:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 27 pid: 13825 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787274.849761:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503711744:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787274.849996:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c12edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787274.865277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787274.866572:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6527:1874630503711744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1787787274.866604:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787274.869738:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484796544 00000100:00100000:1.0:1787787274.869755:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484796544 00000100:00100000:1.0:1787787274.869831:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:1.0:1787787274.869842:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:6161:x1874630484796544:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787787274.870744:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:6161:x1874630484796544:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 900us (5475us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787787274.870757:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:2.0:1787787274.879216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787274.879303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484796672 00000100:00100000:0.0:1787787274.879313:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484796672 00010000:00010000:0.0:1787787274.879365:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 29 pid: 13825 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787274.879415:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 107 00000100:00100000:0.0:1787787274.879424:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:2391:x1874630484796672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787274.879438:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787274.879444:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 29 pid: 13825 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.879459:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 29 pid: 13825 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.879720:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30a9c76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8460 expref: 29 pid: 13825 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.879737:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787274.879742:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.879753:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.879761:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787274.879794:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787274.879923:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.879932:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787274.879992:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787787274.879997:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787274.880019:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880032:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880053:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880061:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880068:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880074:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.880078:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880085:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880182:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787274.880186:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.880192:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880198:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3000/0x11620bc3f30a9d5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880222:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880228:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880238:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880243:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787274.880246:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880251:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880259:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff986fc2a19c00) 00010000:00010000:3.0:1787787274.880261:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787274.880264:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880269:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880301:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c849f expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880313:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c849f expref: 28 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787274.880331:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787274.880333:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787274.880406:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2200, rc 0) 00000100:00100000:0.0:1787787274.880498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:2391:x1874630484796672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1073us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.880507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 107 00000100:00100000:3.0:1787787274.883213:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12451:x1874630484796288:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 34170us (34513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787274.883227:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 249 00010000:00010000:3.0:1787787275.050775:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787275.626619:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787275.626650:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503711872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787275.626821:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787275.628345:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503711872 00000100:00100000:0.0:1787787275.628365:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503711872 00000100:00100000:0.0:1787787275.628440:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787787275.628452:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503711872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787275.628503:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787787275.628616:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503711872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787275.628624:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787787275.629323:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503711872:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1787787275.631253:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787787275.631277:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:2.0:1787787275.818248:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787275.818260:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787275.818291:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787787275.818299:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787275.818444:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503712000:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787275.818530:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787275.826611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787275.829242:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484796800 00000100:00100000:1.0:1787787275.829260:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484796800 00000100:00100000:1.0:1787787275.830508:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 250 00000100:00100000:1.0:1787787275.830528:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:12462:x1874630484796800:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787787275.830712:0:7753:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787787275.830862:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:12462:x1874630484796800:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 342us (4262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787275.830871:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 250 00000100:00080000:2.0:1787787275.831864:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787275.836688:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1874630503712000:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787275.842788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787275.842896:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484797056 00000100:00100000:3.0:1787787275.842906:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484797056 00000100:00100000:3.0:1787787275.842968:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 251 00000100:00100000:3.0:1787787275.842979:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+27:12462:x1874630484797056:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787275.843002:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787275.843039:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c84a6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787275.843190:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787275.843206:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787275.843221:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787275.843243:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787787275.843356:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84a6 expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787275.843373:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84a6 expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787275.843382:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787275.843384:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787275.843388:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3e00, rc 0) 00000100:00100000:3.0:1787787275.843445:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:12462:x1874630484797056:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 468us (669us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787787275.843453:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 251 00000040:00080000:0.0:1787787275.847190:0:14715:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787275.847201:0:14715:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787275.847241:0:14715:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787787275.847247:0:14715:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787275.851669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787275.852647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484797184 00000100:00100000:3.0:1787787275.852660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484797184 00000100:00100000:3.0:1787787275.852852:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:3.0:1787787275.852865:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:2392:x1874630484797184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787275.852884:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787275.852916:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3e00/0x11620bc3f30a9d79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84a6 expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787275.852938:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787275.852943:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787275.853011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:2392:x1874630484797184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 149us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787275.853019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:0.0:1787787275.853355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787275.853439:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484797440 00000100:00100000:0.0:1787787275.853444:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484797440 00000100:00100000:0.0:1787787275.853479:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 252 00000100:00100000:0.0:1787787275.853487:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+28:12462:x1874630484797440:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787787275.853622:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853638:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853649:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853799:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853806:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853812:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853817:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787275.853822:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853830:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853849:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:0.0:1787787275.853852:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787275.853856:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787275.853862:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30a9d87 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787275.853950:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:12462:x1874630484797440:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 464us (595us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787787275.853958:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 252 00000040:00080000:0.0:1787787275.854048:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787275.854052:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787275.858339:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787787275.858357:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787275.863664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787275.863741:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484797696 00000100:00100000:1.0:1787787275.863751:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484797696 00000100:00100000:1.0:1787787275.863815:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:1.0:1787787275.863825:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+29:12462:x1874630484797696:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787787275.864054:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:12462:x1874630484797696:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 231us (398us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787787275.864062:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00010000:00010000:1.0:1787787276.073968:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787276.137518:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787276.137543:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503712128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787276.137615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787276.137781:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712128 00000100:00100000:1.0:1787787276.137789:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712128 00000100:00100000:1.0:1787787276.137851:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787787276.137879:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503712128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787276.137911:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787787276.137965:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503712128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787276.137972:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1787787276.137989:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787276.138105:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787276.138127:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503712256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787276.138190:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787276.139439:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712256 00000100:00100000:1.0:1787787276.139449:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712256 00000100:00100000:1.0:1787787276.139563:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787787276.139573:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503712256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787276.139604:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787787276.139664:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503712256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787276.139671:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787787276.139732:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503712256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787276.139880:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503712128:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787787276.140194:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787276.142987:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503712384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787276.143082:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787276.143220:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712384 00000100:00100000:3.0:1787787276.143229:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712384 00000100:00100000:3.0:1787787276.143283:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787276.143292:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503712384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787276.143329:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787787276.143377:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503712384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787276.143385:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787787276.143478:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503712384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787276.147485:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503712768:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.147557:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.147609:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503713280:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.147634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.147661:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787787276.147668:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503712640:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.147690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.147708:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503713152:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.147731:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.147751:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4296940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503713664:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.147770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.147799:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713280 00000100:00100000:2.0:1787787276.147806:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713280 00000100:00100000:2.0:1787787276.147871:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787787276.147879:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503713280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.147928:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503713280:12345-0@lo:400:kworker.0 Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.147948:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787787276.147970:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712768 00000100:00100000:2.0:1787787276.147974:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712768 00000100:00100000:2.0:1787787276.147996:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712640 00000100:00100000:2.0:1787787276.147999:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712640 00000100:00100000:2.0:1787787276.148014:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713152 00000100:00100000:2.0:1787787276.148028:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713152 00000100:00100000:2.0:1787787276.148043:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713664 00000100:00100000:2.0:1787787276.148046:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713664 00000100:00100000:2.0:1787787276.148060:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787787276.148066:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503712768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148097:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503712768:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148103:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787787276.148115:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787787276.148120:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503712640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148168:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503712640:12345-0@lo:400:kworker.0 Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148174:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787787276.148185:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787787276.148191:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503713152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148216:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503713152:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148221:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787787276.148234:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787787276.148240:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503713664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148278:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503713664:12345-0@lo:400:kworker.0 Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148284:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:2.0:1787787276.148312:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787276.148317:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787276.148326:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503712896:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148351:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.148371:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503713408:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148391:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.148407:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787787276.148412:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503712512:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148435:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.148453:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503713024:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148469:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.148480:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4294b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503713536:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148496:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787276.148516:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712512 00000100:00100000:2.0:1787787276.148519:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712512 00000100:00100000:2.0:1787787276.148542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787787276.148548:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148580:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503712512:12345-0@lo:400:kworker.0 Request processed in 32us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148585:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787787276.148614:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713024 00000100:00100000:2.0:1787787276.148617:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713024 00000100:00100000:2.0:1787787276.148639:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713536 00000100:00100000:2.0:1787787276.148647:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713536 00000100:00100000:2.0:1787787276.148669:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787787276.148675:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503713024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148704:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503713024:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148709:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787787276.148718:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787787276.148724:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503713536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148745:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503713536:12345-0@lo:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148750:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:2.0:1787787276.148765:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787276.148772:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503712896 00000100:00100000:2.0:1787787276.148775:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503712896 00000100:00100000:2.0:1787787276.148794:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787787276.148799:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503712896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148826:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503712896:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787276.148831:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787787276.148861:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503712512:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148872:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503713024:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148879:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4294b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503713536:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148886:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503712896:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148917:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503712640:0@lo:400:kworker.0 00010000:00080000:2.0:1787787276.148937:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff987101f792c0 x1874630503713152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787276.148947:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503713152:0@lo:400:kworker.0 00010000:00080000:2.0:1787787276.148956:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4296940 x1874630503713664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787276.148964:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4296940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503713664:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148974:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503712768:0@lo:400:kworker.0 00000100:00100000:2.0:1787787276.148982:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503713280:0@lo:400:kworker.0 00000100:00100000:3.0:1787787276.149096:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713408 00000100:00100000:3.0:1787787276.149100:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713408 00000100:00100000:3.0:1787787276.149158:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787787276.149166:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503713408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787276.149203:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503713408:12345-0@lo:400:kworker.0 Request processed in 39us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787276.149209:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1787787276.151564:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787276.151616:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787787276.151623:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1787787276.151659:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff986fc489bc00, transno 4294967308 00000004:00080000:2.0:1787787276.151682:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787787276.151690:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff987101f79e00, transno 4294967311 00000100:00100000:2.0:1787787276.151699:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503713408:0@lo:400:kworker.0 00010000:00010000:0.0:1787787277.100628:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787277.959898:0:14766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787277.959908:0:14766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787277.959941:0:14766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787787277.959947:0:14766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787787278.004897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.004939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.005009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.005041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.005072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.005094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787278.005133:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484797952 00000100:00100000:3.0:1787787278.005164:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484797952 00000100:00100000:3.0:1787787278.005225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 331 00000100:00100000:3.0:1787787278.005237:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:2392:x1874630484797952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787278.005323:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:2392:x1874630484797952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.005331:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 331 00000100:00100000:3.0:1787787278.005347:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798464 00000100:00100000:3.0:1787787278.005350:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798464 00000100:00100000:3.0:1787787278.005372:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798080 00000100:00100000:3.0:1787787278.005375:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798080 00000100:00100000:3.0:1787787278.005392:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 332 00000100:00100000:3.0:1787787278.005398:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484798464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787278.005431:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484798464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.005437:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 332 00000100:00100000:3.0:1787787278.005448:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 333 00000100:00100000:3.0:1787787278.005453:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484798080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787278.005475:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484798080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.005481:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 333 00000100:00080000:3.0:1787787278.005495:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787278.005499:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787278.019296:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798208 00000100:00100000:0.0:1787787278.019314:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798208 00000100:00100000:3.0:1787787278.025540:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798336 00000100:00100000:3.0:1787787278.025556:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798336 00000100:00100000:3.0:1787787278.025627:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:3.0:1787787278.025640:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484798208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787278.025723:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484798208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (20783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.025731:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:3.0:1787787278.025750:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:3.0:1787787278.025757:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484798336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787278.025784:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2392:x1874630484798336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (20689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.025790:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00080000:3.0:1787787278.025819:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787278.025822:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787278.026027:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484797824 00000100:00100000:1.0:1787787278.026032:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484797824 00000100:00100000:0.0:1787787278.026391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.027530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 389 00000100:00100000:1.0:1787787278.027540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484797824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787278.027595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2392:x1874630484797824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (22554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787278.027602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 389 00000100:00100000:3.0:1787787278.028896:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798592 00000100:00100000:3.0:1787787278.028909:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798592 00000100:00100000:3.0:1787787278.028977:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00100000:3.0:1787787278.028998:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484798592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787278.029067:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484798592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.029075:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 334 00000100:00080000:1.0:1787787278.029484:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787787278.121807:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787278.216829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787278.216913:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798848 00000100:00100000:3.0:1787787278.216922:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798848 00000100:00100000:3.0:1787787278.216993:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 253 00000100:00100000:3.0:1787787278.217002:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+30:12483:x1874630484798848:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787278.217023:0:13825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787278.217042:0:13825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c84ad expref: -99 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787278.217861:0:13825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9d95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787278.217881:0:13825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787278.217893:0:13825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787278.217905:0:13825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787787278.218033:0:13825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f3800/0x11620bc3f30a9d8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84ad expref: 33 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787278.218070:0:13825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84ad expref: 32 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787278.218080:0:13825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:2.0:1787787278.218083:0:13825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787787278.218087:0:13825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3200, rc 0) 00000100:00100000:2.0:1787787278.218503:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:12483:x1874630484798848:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1500us (1683us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787787278.218512:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 253 00000100:00100000:3.0:1787787278.223478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787278.227499:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484798976 00000100:00100000:1.0:1787787278.227515:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484798976 00000100:00100000:1.0:1787787278.227585:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 254 00000100:00100000:1.0:1787787278.227595:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:12483:x1874630484798976:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:1.0:1787787278.227660:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227680:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227698:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227737:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227744:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227751:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227758:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787278.227762:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227783:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227797:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:1.0:1787787278.227800:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787278.227805:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787278.227812:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0000/0x11620bc3f30a9da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787278.227890:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+32:12483:x1874630484798976:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 296us (4424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787278.227898:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 254 00000100:00100000:3.0:1787787278.341395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787278.341509:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799104 00000100:00100000:0.0:1787787278.341520:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799104 00000100:00100000:0.0:1787787278.341580:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:0.0:1787787278.341591:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2393:x1874630484799104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1787787278.341623:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787278.341645:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c847afe1/0x11620bc3f30a9daa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c84b4 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787278.341669:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f780a, atime: 0x6a8f780a, ctime: 0x6a8f780a, blocks: 0x8 00010000:00010000:0.0:1787787278.341689:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1787787278.341694:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787278.341704:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c847afe1/0x11620bc3f30a9daa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84b4 expref: 8 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787278.341721:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c847afe1/0x11620bc3f30a9daa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84b4 expref: 8 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787278.341733:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15400, rc 0) 00000100:00100000:0.0:1787787278.341805:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2393:x1874630484799104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 217us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787278.341812:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:0.0:1787787278.355554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787278.355647:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799232 00000100:00100000:3.0:1787787278.355658:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799232 00002000:00100000:3.0:1787787278.355709:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff986fc4297480 x1874630484799232/t0(0) o3->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:139/0 lens 488/0 e 0 to 0 dl 1787787289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787278.355719:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc4297480 with x1874630484799232 ext(0->4095) 00002000:00010000:3.0:1787787278.355724:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc4297480 00000100:00100000:3.0:1787787278.355757:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:3.0:1787787278.355768:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484799232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1787787278.355991:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+8:2392:x1874630484799232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 224us (446us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787787278.356000:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00002000:00100000:3.0:1787787278.356007:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff986fc4297480 x1874630484799232/t0(0) o3->99b164f2-528a-4a42-8406-031dcbc8cfdb@192.168.204.31@tcp:139/0 lens 488/4536 e 0 to 0 dl 1787787289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787278.356016:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff986fc4297480 with x1874630484799232 ext(0->4095) 00002000:00010000:3.0:1787787278.356019:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff986fc4297480 00000100:00100000:2.0:1787787278.697560:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503713792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787278.697630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787278.697927:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713792 00000100:00100000:1.0:1787787278.697937:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713792 00000100:00100000:1.0:1787787278.698031:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787787278.698042:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503713792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787278.698101:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787278.698176:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503713792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787278.698182:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787278.698373:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503713792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787787278.698442:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787278.698841:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503713920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787278.698878:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787278.699636:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503713920 00000100:00100000:3.0:1787787278.699644:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503713920 00000100:00100000:3.0:1787787278.699706:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787787278.699715:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503713920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787278.699734:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787278.699783:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503713920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787278.699791:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787787278.699827:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503713920:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787787278.699896:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787787279.149292:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787280.169309:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787280.681991:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787280.745440:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787280.745467:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4297840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503714048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787280.745550:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787280.746418:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714048 00000100:00100000:2.0:1787787280.746435:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714048 00000100:00100000:2.0:1787787280.746506:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787787280.746518:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503714048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787280.746561:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787787280.746639:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503714048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787280.746647:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787787280.746852:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4297840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503714048:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787787280.748017:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1787787280.748053:0:6506:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870d16f10c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787787280.748057:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3518a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870d16f1840 00000020:00080000:3.0:1787787280.748061:0:6506:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff986fc3518800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870d14be200 00000020:00080000:3.0:1787787280.748081:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1787787280.748246:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787280.748277:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787280.748284:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787280.748289:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787280.748294:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787280.748301:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787280.748320:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9870d0e3e500) 00010000:00010000:0.0:1787787280.748323:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787280.748328:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787280.748334:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30a9d25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13672 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787787280.748656:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787787280.748740:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1787787280.749560:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1787787280.749570:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000040:00080000:3.0:1787787281.001328:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787281.001338:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787281.001362:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787787281.001371:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787787281.196276:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787281.257490:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503714176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787281.257572:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.257816:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503714432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.257850:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.257873:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503714944:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.257896:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.257914:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503715456:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.257949:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.257966:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787787281.257981:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503714560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.258006:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.258030:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503715072:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.258053:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.258070:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503715584:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.258090:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787281.258121:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714432 00000100:00100000:1.0:1787787281.258128:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714432 00000100:00100000:0.0:1787787281.258333:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714944 00000100:00100000:0.0:1787787281.258338:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714944 00000100:00100000:3.0:1787787281.258420:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714176 00000100:00100000:3.0:1787787281.258425:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714176 00000100:00100000:3.0:1787787281.258468:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787787281.258478:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503714176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787281.258511:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787787281.258559:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503714176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787281.258566:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787787281.258616:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715456 00000100:00100000:3.0:1787787281.258620:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715456 00000100:00100000:1.0:1787787281.258667:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715072 00000100:00100000:1.0:1787787281.258671:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715072 00000100:00100000:2.0:1787787281.259322:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503714304:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.259413:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503714816:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259436:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.259455:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503715328:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259476:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.259495:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787787281.259500:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503714688:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.259528:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503715200:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.259562:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503715712:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259581:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.259655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714304 00000100:00100000:2.0:1787787281.259659:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714304 00000100:00100000:2.0:1787787281.259691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787787281.259699:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503714304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503714304:12345-0@lo:400:kworker.0 Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.259739:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787787281.259769:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714560 00000100:00100000:2.0:1787787281.259773:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714560 00000100:00100000:2.0:1787787281.259789:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714816 00000100:00100000:2.0:1787787281.259792:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714816 00000100:00100000:2.0:1787787281.259804:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787787281.259810:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503714560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259843:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503714560:12345-0@lo:400:kworker.0 Request processed in 33us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.259859:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787787281.259871:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787787281.259877:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503714816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.259905:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503714816:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.259910:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787787281.259938:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715328 00000100:00100000:2.0:1787787281.259941:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715328 00000100:00100000:2.0:1787787281.259968:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715200 00000100:00100000:2.0:1787787281.259971:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715200 00000100:00100000:2.0:1787787281.259987:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715712 00000100:00100000:2.0:1787787281.259989:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715712 00000100:00100000:2.0:1787787281.260004:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787787281.260010:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503715328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260040:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503715328:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.260045:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787787281.260056:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787281.260062:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503715200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260084:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503715200:12345-0@lo:400:kworker.0 Request processed in 23us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.260089:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787281.260099:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787787281.260104:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503715712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260128:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503715712:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.260160:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787787281.260198:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503715840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787281.260225:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787281.260261:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503715200:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260271:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503715712:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260280:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503714304:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260288:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503714816:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260297:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503715328:0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.260330:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715840 00000100:00100000:2.0:1787787281.260334:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715840 00000100:00100000:2.0:1787787281.260351:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787787281.260357:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503715840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787281.260381:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787787281.260417:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503715840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.260423:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787787281.260449:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503715840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787281.260489:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715584 00000100:00100000:2.0:1787787281.260494:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715584 00000100:00100000:0.0:1787787281.262320:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503714688 00000100:00100000:0.0:1787787281.262332:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503714688 00000100:00100000:0.0:1787787281.262364:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787787281.262372:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503714432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.262464:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503714432:12345-0@lo:400:kworker.0 Request processed in 92us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787281.262471:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787787281.262489:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787787281.262496:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503714944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.262526:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503714944:12345-0@lo:400:kworker.0 Request processed in 31us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787281.262531:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787787281.262542:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787787281.262548:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503714688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.262587:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503714688:12345-0@lo:400:kworker.0 Request processed in 40us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787281.262593:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:0.0:1787787281.262616:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787281.262622:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787281.262624:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787281.262627:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787281.262670:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1787787281.262676:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff986fc43fb840, transno 4294967323 00000004:00080000:0.0:1787787281.262689:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1787787281.262720:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503714176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787281.262973:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503714688:0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.263023:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503715968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787281.263062:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787281.263097:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503714560:0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.263122:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503714432:0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.263132:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503714944:0@lo:400:kworker.0 00000100:00100000:0.0:1787787281.263269:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503715968 00000100:00100000:0.0:1787787281.263274:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503715968 00000100:00100000:0.0:1787787281.263304:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787787281.263313:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503715968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787281.263328:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787787281.263364:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503715968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787281.263370:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787787281.263402:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503715968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787281.263779:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787787281.263791:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503715456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787281.263849:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503715456:12345-0@lo:400:kworker.0 Request processed in 61us (5899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787281.263855:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787787281.264199:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503715456:0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.264531:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787787281.264544:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787281.264644:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503715072:12345-0@lo:400:kworker.0 Request processed in 105us (6589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787281.264650:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787787281.264766:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787787281.264777:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503715584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787281.264814:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503715584:12345-0@lo:400:kworker.0 Request processed in 41us (6722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787281.264934:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00080000:3.0:1787787281.266278:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327da40 x1874630503715072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787281.266297:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503715072:0@lo:400:kworker.0 00010000:00080000:2.0:1787787281.271115:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327e580 x1874630503715584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787281.271135:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503715584:0@lo:400:kworker.0 00010000:00010000:1.0:1787787282.218027:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787283.128070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787283.128111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787283.128160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787283.128325:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799744 00000100:00100000:2.0:1787787283.128336:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799744 00000100:00100000:2.0:1787787283.128411:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:2.0:1787787283.128424:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484799744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787283.128496:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2392:x1874630484799744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787283.128503:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00080000:1.0:1787787283.128647:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787283.128709:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799488 00000100:00100000:0.0:1787787283.128714:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799488 00000100:00100000:0.0:1787787283.128764:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800000 00000100:00100000:0.0:1787787283.128767:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800000 00000100:00100000:0.0:1787787283.128790:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 341 00000100:00100000:0.0:1787787283.128796:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2392:x1874630484799488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787283.128831:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2392:x1874630484799488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787283.128837:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 341 00000100:00100000:0.0:1787787283.128850:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00100000:0.0:1787787283.128856:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484800000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787283.128877:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2392:x1874630484800000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787283.128902:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00080000:1.0:1787787283.129134:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787283.133605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787283.133651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787283.133685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787283.133721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787283.133803:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799616 00000100:00100000:3.0:1787787283.133815:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799616 00000100:00100000:3.0:1787787283.133879:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800128 00000100:00100000:3.0:1787787283.133893:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800128 00000100:00100000:3.0:1787787283.133923:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:3.0:1787787283.133933:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484799616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787283.134034:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484799616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787283.134042:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 343 00000100:00100000:3.0:1787787283.134073:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 344 00000100:00100000:3.0:1787787283.134081:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484800128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787283.134106:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484800128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787283.134113:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 344 00000100:00080000:0.0:1787787283.134367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787283.134535:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799872 00000100:00100000:2.0:1787787283.134541:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799872 00000100:00100000:2.0:1787787283.134592:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 143 00000100:00100000:2.0:1787787283.134601:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484799872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787283.134640:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484799872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787283.134646:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 143 00000100:00080000:0.0:1787787283.136709:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787283.136799:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484799360 00000100:00100000:1.0:1787787283.136811:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484799360 00000100:00100000:1.0:1787787283.136880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 391 00000100:00100000:1.0:1787787283.136900:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484799360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787283.136998:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484799360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787283.137006:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 391 00010000:00010000:0.0:1787787283.244311:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787283.817405:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503716096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787283.818313:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503716224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787283.818393:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787283.818474:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716224 00000100:00100000:1.0:1787787283.818483:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716224 00000100:00100000:1.0:1787787283.818541:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787787283.818551:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503716224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787283.818585:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787283.818646:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503716224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787283.818656:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787283.818660:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787787283.818682:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716096 00000100:00100000:1.0:1787787283.818687:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716096 00000100:00100000:1.0:1787787283.818713:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787787283.818720:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503716096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787283.818731:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787283.818774:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503716096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787283.818780:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787787283.818805:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787283.818849:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503716224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787283.819076:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503716096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787787284.266100:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787284.325322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787284.325469:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800256 00000100:00100000:2.0:1787787284.325480:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800256 00000100:00100000:2.0:1787787284.325545:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 255 00000100:00100000:2.0:1787787284.325555:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:12137:x1874630484800256:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787787284.325668:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:12137:x1874630484800256:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 Request processed in 114us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787284.325694:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 255 00000100:00100000:1.0:1787787284.340320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787284.340428:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800384 00000100:00100000:3.0:1787787284.340440:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800384 00000100:00100000:3.0:1787787284.340660:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 256 00000100:00100000:3.0:1787787284.340673:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:12137:x1874630484800384:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787787284.340783:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:12137:x1874630484800384:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 Request processed in 113us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787284.340792:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 256 00000100:00100000:0.0:1787787284.348269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787284.350670:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800640 00000100:00100000:2.0:1787787284.350685:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800640 00000100:00100000:2.0:1787787284.350821:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:2.0:1787787284.350845:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:12137:x1874630484800640:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787787284.351164:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:12137:x1874630484800640:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 322us (2904us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787787284.351173:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:1.0:1787787284.780393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787284.780616:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800768 00000100:00100000:0.0:1787787284.780626:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800768 00000100:00100000:0.0:1787787284.780693:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 257 00000100:00100000:0.0:1787787284.780704:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+5:12940:x1874630484800768:12345-192.168.204.31@tcp:101:lsof.0 00010000:00010000:0.0:1787787284.780724:0:7753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787284.780744:0:7753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30a9db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c84bb expref: -99 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787284.780809:0:7753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787284.780824:0:7753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787284.780837:0:7753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787284.780893:0:7753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787284.780897:0:7753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787284.780916:0:7753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787284.780956:0:7753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30a9db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84bb expref: 7 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787284.780976:0:7753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84bb expref: 6 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787284.780985:0:7753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:0.0:1787787284.780988:0:7753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787284.780991:0:7753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15c00, rc 0) 00000100:00100000:0.0:1787787284.781057:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12b28a37-797d-4b20-85b7-441f77f74f4f+6:12940:x1874630484800768:12345-192.168.204.31@tcp:101:lsof.0 Request processed in 354us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787284.781064:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 257 00010000:00010000:1.0:1787787285.291347:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787285.865560:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787285.865585:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503716352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787285.865653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787285.865854:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716352 00000100:00100000:3.0:1787787285.865862:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716352 00000100:00100000:3.0:1787787285.865911:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787787285.865919:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503716352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787285.865964:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787787285.866016:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503716352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787285.866031:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787787285.866174:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503716352:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787787286.313360:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787286.377447:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503716480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787286.377522:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787286.377781:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716480 00000100:00100000:1.0:1787787286.377789:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716480 00000100:00100000:1.0:1787787286.377851:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787787286.377862:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503716480:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787286.378100:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503716864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787286.378156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.378263:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503716992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378289:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.378305:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503717504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378320:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.378336:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787787286.378350:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503716608:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378375:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.378395:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503717120:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378412:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.378423:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503717632:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378438:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.378457:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716864 00000100:00100000:3.0:1787787286.378461:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716864 00000100:00100000:3.0:1787787286.378488:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716992 00000100:00100000:3.0:1787787286.378491:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716992 00000100:00100000:3.0:1787787286.378511:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717504 00000100:00100000:3.0:1787787286.378513:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717504 00000100:00100000:3.0:1787787286.378524:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717120 00000100:00100000:3.0:1787787286.378525:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717120 00000100:00100000:3.0:1787787286.378535:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717632 00000100:00100000:3.0:1787787286.378536:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717632 00000100:00100000:3.0:1787787286.378563:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787787286.378568:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503716864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378606:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503716864:12345-0@lo:400:kworker.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.378612:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787787286.378625:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787787286.378630:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503716992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378651:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503716992:12345-0@lo:400:kworker.0 Request processed in 21us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.378656:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787787286.378664:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787787286.378668:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503717504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378686:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503717504:12345-0@lo:400:kworker.0 Request processed in 18us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.378691:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787787286.378699:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787787286.378703:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503717120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378720:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503717120:12345-0@lo:400:kworker.0 Request processed in 17us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.378726:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787787286.378734:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787787286.378738:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503717632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378755:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503717632:12345-0@lo:400:kworker.0 Request processed in 17us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.378760:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787787286.378782:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716608 00000100:00100000:3.0:1787787286.378784:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716608 00000100:00100000:3.0:1787787286.378808:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787787286.378815:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503716608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503716608:12345-0@lo:400:kworker.0 Request processed in 41us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.378862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:3.0:1787787286.378904:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787286.378907:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787286.378934:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503716608:0@lo:400:kworker.0 00010000:00080000:3.0:1787787286.378948:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43fb840 x1874630503717120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787286.378959:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503717120:0@lo:400:kworker.0 00010000:00080000:3.0:1787787286.378969:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327e580 x1874630503717632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787286.378977:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503717632:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.378992:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503716992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379000:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503717504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379048:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503716736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.379093:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503717248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.379131:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503717760:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787286.379238:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503716736 00000100:00100000:3.0:1787787286.379242:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503716736 00000100:00100000:3.0:1787787286.379266:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787787286.379272:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503716736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379310:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503716736:12345-0@lo:400:kworker.0 Request processed in 38us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.379316:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787787286.379342:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503716736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379374:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717248 00000100:00100000:3.0:1787787286.379378:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717248 00000100:00100000:3.0:1787787286.379408:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717760 00000100:00100000:3.0:1787787286.379411:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717760 00000100:00100000:3.0:1787787286.379429:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787787286.379435:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503717248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379467:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503717248:12345-0@lo:400:kworker.0 Request processed in 33us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.379473:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787787286.379484:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787787286.379490:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503717760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379516:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503717760:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.379521:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787787286.379534:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787286.379537:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787286.379551:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503717248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.379572:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503717760:0@lo:400:kworker.0 00000100:00100000:2.0:1787787286.379932:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503716864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787286.379941:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503717376:0@lo:400:kworker.0 00000100:00100000:2.0:1787787286.379971:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787286.379999:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503717888:0@lo:400:kworker.0 00000100:00100000:2.0:1787787286.380022:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787286.380056:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717376 00000100:00100000:2.0:1787787286.380062:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717376 00000100:00100000:2.0:1787787286.380090:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503717888 00000100:00100000:2.0:1787787286.380093:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503717888 00000100:00100000:2.0:1787787286.380113:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787286.380119:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503717376:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1787787286.380288:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787787286.380379:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787787286.380389:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503717888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787286.380544:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503718144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787286.380680:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503716480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2819us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787286.380689:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787787286.380745:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503718016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787286.380775:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787286.380813:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503716480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787286.380850:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718016 00000100:00100000:1.0:1787787286.380854:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718016 00000100:00100000:1.0:1787787286.380890:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787787286.380896:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503718016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787286.380916:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787787286.380946:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503718016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787286.380952:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787787286.380979:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503718016:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787787286.381004:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787286.381016:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787286.381128:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503717376:12345-0@lo:400:kworker.0 Request processed in 1008us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787286.381170:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787286.381214:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503717376:0@lo:400:kworker.0 00000100:00100000:3.0:1787787286.381472:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503717888:12345-0@lo:400:kworker.0 Request processed in 1084us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787286.381478:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787787286.381544:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503717888:0@lo:400:kworker.0 00000100:00100000:0.0:1787787286.381596:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787286.381688:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718144 00000100:00100000:1.0:1787787286.381693:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718144 00000100:00100000:1.0:1787787286.381759:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787787286.381766:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503718144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787286.381779:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787787286.381831:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503718144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787286.381838:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787787286.381901:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503718144:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787787286.891572:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1787787286.891590:0:6506:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787787286.891661:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787787286.891674:0:6559:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787787287.337475:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787288.243031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787288.243074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787288.243101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787288.243165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787288.243170:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801280 00000100:00100000:0.0:1787787288.243181:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801280 00000100:00100000:1.0:1787787288.243189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787288.243209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787288.243235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787288.243238:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801408 00000100:00100000:0.0:1787787288.243241:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801408 00000100:00100000:1.0:1787787288.243257:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801024 00000100:00100000:1.0:1787787288.243260:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801024 00000100:00100000:0.0:1787787288.243263:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00100000:0.0:1787787288.243272:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484801280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787288.243288:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801536 00000100:00100000:1.0:1787787288.243291:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801536 00000100:00100000:1.0:1787787288.243306:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801152 00000100:00100000:1.0:1787787288.243308:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801152 00000100:00100000:1.0:1787787288.243319:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801664 00000100:00100000:1.0:1787787288.243321:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801664 00000100:00100000:1.0:1787787288.243334:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 351 00000100:00100000:1.0:1787787288.243340:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2391:x1874630484801024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787288.243348:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484801280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787288.243383:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 352 00000100:00100000:1.0:1787787288.243385:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:2391:x1874630484801024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787288.243390:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00100000:0.0:1787787288.243407:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 149 00000100:00100000:0.0:1787787288.243488:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484801408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787288.243516:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2391:x1874630484801408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787288.243522:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 149 00000100:00080000:0.0:1787787288.243539:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787288.243540:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2391:x1874630484801536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1787787288.243545:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787288.243550:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787288.243552:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787288.243579:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2391:x1874630484801536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787288.243722:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 351 00000100:00100000:1.0:1787787288.243738:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 353 00000100:00100000:0.0:1787787288.244540:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 354 00000100:00100000:0.0:1787787288.244553:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484801664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787288.244604:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484801664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787288.244611:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 354 00000100:00100000:1.0:1787787288.245723:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484801152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787288.245840:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2391:x1874630484801152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2095us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787288.245849:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 353 00000100:00100000:2.0:1787787288.247351:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 352 00000100:00100000:3.0:1787787288.247371:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484800896 00000100:00100000:3.0:1787787288.247382:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484800896 00000100:00100000:2.0:1787787288.247635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 393 00000100:00100000:2.0:1787787288.247648:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484800896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787288.247719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484800896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (4579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787288.247726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 393 00010000:00010000:1.0:1787787288.361411:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787288.865514:0:14964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:34:47 (1787787287) 00000100:00100000:3.0:1787787288.937332:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503718272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787288.937415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787288.937560:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718272 00000100:00100000:1.0:1787787288.937568:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718272 00000100:00100000:1.0:1787787288.937632:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787288.937640:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503718272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787288.937669:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787787288.937723:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503718272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787288.937730:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787288.937786:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503718272:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787787288.937975:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787288.938626:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787288.938639:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503718400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787288.938926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787288.939002:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718400 00000100:00100000:3.0:1787787288.939008:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718400 00000100:00100000:3.0:1787787288.939069:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787787288.939078:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503718400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787288.939095:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787288.939134:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503718400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787288.939160:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787787288.939270:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503718400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787288.939323:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787787289.389289:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787290.409522:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787290.922029:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787290.988349:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787290.988376:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503718528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787290.988468:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787290.988655:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718528 00000100:00100000:1.0:1787787290.988663:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718528 00000100:00100000:1.0:1787787290.988728:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787787290.988752:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503718528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787290.988791:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787290.988862:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503718528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787290.988870:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787787290.988920:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503718528:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787787291.241463:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787291.241474:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787291.241619:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787787291.241628:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787787291.433879:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787291.497311:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4297840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503718656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787291.497398:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.497469:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718656 00000100:00100000:3.0:1787787291.497471:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503719040:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.497479:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718656 00000100:00100000:0.0:1787787291.497485:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503719168:0@lo:400:kworker.0 00000100:00100000:3.0:1787787291.497520:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787291.497532:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.497556:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787787291.497569:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503718656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787291.497573:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503719552:0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.497574:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503719680:0@lo:400:kworker.0 00002000:00000024:1.0:1787787291.497609:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787787291.497615:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787291.497638:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719168 00000100:00100000:0.0:1787787291.497643:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719168 00000100:00100000:3.0:1787787291.497651:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503720064:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.497677:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503718656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787291.497687:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.497691:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787787291.497691:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787787291.497706:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503719168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787787291.497735:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787291.497744:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503718784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.497753:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719040 00000100:00100000:1.0:1787787291.497758:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719040 00000100:00100000:0.0:1787787291.497766:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503719168:12345-0@lo:400:kworker.0 Request processed in 63us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787291.497774:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787787291.497792:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787787291.497798:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.497805:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503719040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.497806:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719552 00000100:00100000:0.0:1787787291.497812:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719552 00000100:00100000:3.0:1787787291.497833:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503719296:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.497857:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503719040:12345-0@lo:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787291.497857:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720064 00000100:00100000:0.0:1787787291.497863:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720064 00000100:00100000:3.0:1787787291.497871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.497871:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787787291.497899:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718784 00000100:00100000:3.0:1787787291.497900:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503719808:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.497905:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718784 00000100:00100000:0.0:1787787291.497907:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787787291.497917:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503719552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787291.497933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.497942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787787291.497953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503718784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.497966:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503719552:12345-0@lo:400:kworker.0 Request processed in 50us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787291.497971:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787787291.497975:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787787291.497982:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503718912:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.497993:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503718784:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787291.497995:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787787291.498007:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787291.498014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.498024:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787787291.498045:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503719424:0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.498061:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503720064:12345-0@lo:400:kworker.0 Request processed in 56us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787291.498063:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719296 00000100:00100000:1.0:1787787291.498069:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719296 00000100:00100000:0.0:1787787291.498070:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787787291.498076:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787291.498097:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503719936:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.498103:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719808 00000100:00100000:1.0:1787787291.498108:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719808 00000100:00100000:0.0:1787787291.498109:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503718912 00000100:00100000:0.0:1787787291.498114:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503718912 00000100:00100000:3.0:1787787291.498125:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787291.498225:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787291.498234:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503720320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787291.498271:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787291.498376:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503718784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501386:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719424 00000100:00100000:0.0:1787787291.501387:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719936 00000100:00100000:1.0:1787787291.501402:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719424 00000100:00100000:0.0:1787787291.501402:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719936 00000100:00100000:1.0:1787787291.501466:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787787291.501481:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503719296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501602:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503719296:12345-0@lo:400:kworker.0 Request processed in 126us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787291.501609:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787787291.501627:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787787291.501634:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503719808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501662:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503719808:12345-0@lo:400:kworker.0 Request processed in 29us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787291.501668:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787787291.501679:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787787291.501685:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503718912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501712:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503718912:12345-0@lo:400:kworker.0 Request processed in 28us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787291.501718:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787787291.501736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787787291.501790:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503719040:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501812:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503719552:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501824:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503720064:0@lo:400:kworker.0 00000100:00100000:1.0:1787787291.501871:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787291.501883:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503720192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787291.501920:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787291.501954:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720192 00000100:00100000:1.0:1787787291.501958:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720192 00000100:00100000:1.0:1787787291.501984:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787787291.501991:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503720192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787291.502006:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787787291.502041:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503720192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787291.502047:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787787291.502077:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503720192:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787787291.502126:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787291.506765:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787787291.506783:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503719936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.506908:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503719936:12345-0@lo:400:kworker.0 Request processed in 130us (8783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787291.506916:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787787291.506981:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787291.507054:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4297840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503718656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787291.507090:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503719168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.507125:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503719680 00000100:00100000:0.0:1787787291.507132:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503719680 00000100:00100000:0.0:1787787291.507184:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787787291.507191:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503719680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.507228:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503719680:12345-0@lo:400:kworker.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787291.507234:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787787291.507252:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720320 00000100:00100000:0.0:1787787291.507256:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720320 00000100:00100000:0.0:1787787291.507281:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787787291.507288:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503720320:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787291.507297:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503719424:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1787787291.507318:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787787291.507346:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503719424:12345-0@lo:400:kworker.0 Request processed in 5601us (9271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787291.507355:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787787291.507372:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503720320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (9099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787291.507381:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787787291.507416:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503719680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787291.507453:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503720320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787291.507475:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503718912:0@lo:400:kworker.0 00010000:00080000:3.0:1787787291.507505:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f03c0 x1874630503719424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787291.507517:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503719424:0@lo:400:kworker.0 00010000:00080000:3.0:1787787291.507530:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f1a40 x1874630503719936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787291.507538:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503719936:0@lo:400:kworker.0 00000100:00100000:3.0:1787787291.507553:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503719296:0@lo:400:kworker.0 00000100:00100000:3.0:1787787291.507566:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503719808:0@lo:400:kworker.0 00000100:00080000:1.0:1787787291.511545:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787291.511558:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787291.511561:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787787292.457489:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787293.007628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787293.007753:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484801920 00000100:00100000:2.0:1787787293.007764:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484801920 00000100:00100000:2.0:1787787293.007837:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:2.0:1787787293.007849:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+18:13164:x1874630484801920:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:2.0:1787787293.008111:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:13164:x1874630484801920:12345-192.168.204.31@tcp:35:umount.0 Request processed in 265us (494us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787787293.008130:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00080000:1.0:1787787293.008283:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787293.016056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787293.016277:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484802176 00000100:00100000:2.0:1787787293.016289:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484802176 00000100:00100000:2.0:1787787293.016352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:2.0:1787787293.016372:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+19:13164:x1874630484802176:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:2.0:1787787293.016674:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:13164:x1874630484802176:12345-192.168.204.31@tcp:35:umount.0 Request processed in 303us (628us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787787293.016682:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:0.0:1787787293.021492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787293.021597:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484802432 00000100:00100000:2.0:1787787293.021608:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484802432 00000100:00100000:2.0:1787787293.021723:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:2.0:1787787293.021736:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f3667850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+20:13164:x1874630484802432:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:2.0:1787787293.021995:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f3667850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:13164:x1874630484802432:12345-192.168.204.31@tcp:35:umount.0 Request processed in 262us (514us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787787293.022004:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:0.0:1787787293.027010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787293.027346:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484802688 00000100:00100000:3.0:1787787293.027356:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484802688 00000100:00100000:3.0:1787787293.027444:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:3.0:1787787293.027455:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:13164:x1874630484802688:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:3.0:1787787293.027782:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:13164:x1874630484802688:12345-192.168.204.31@tcp:35:umount.0 Request processed in 328us (783us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787787293.027790:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:1.0:1787787293.037266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787293.037314:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787293.037969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484802816 00000100:00100000:0.0:1787787293.037981:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484802816 00000100:00100000:0.0:1787787293.038054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484802944 00000100:00100000:0.0:1787787293.038058:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484802944 00000100:00100000:0.0:1787787293.038079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787293.038087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+14:2391:x1874630484802816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787293.038103:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787293.038169:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8a400/0x11620bc3f30a8d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c800e expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787293.038188:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787293.038261:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+13:2391:x1874630484802816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 174us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787293.038268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787293.038286:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:0.0:1787787293.038293:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:2391:x1874630484802944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787293.038300:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787293.038310:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454f600/0x11620bc3f30a8cd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c7fcf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787293.038318:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787293.038336:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:2391:x1874630484802944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787293.038342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:0.0:1787787293.043985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787293.044047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787293.044181:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484803456 00000100:00100000:2.0:1787787293.044191:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484803456 00000100:00100000:2.0:1787787293.044269:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:2.0:1787787293.044281:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+7:2390:x1874630484803456:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1787787293.044325:0:8443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9323 00000020:00010000:2.0:1787787293.044333:0:8443:0:(genops.c:1921:obd_stale_export_put()) Put export ffff986fc38bc000: total 0 00000100:00080000:2.0:1787787293.044338:0:8443:0:(import.c:65:import_set_state_nolock()) ffff9870c3e9c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787293.044385:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787787293.044563:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2390:x1874630484803456:12345-192.168.204.31@tcp:9:umount.0 Request processed in 284us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787293.044571:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 81 00000020:00010000:3.0:1787787293.044972:0:6516:0:(genops.c:1907:obd_stale_export_get()) Get export ffff986fc38bc000: total 0 00010000:00010000:3.0:1787787293.045009:0:6516:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff986fc38bc000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787787293.045068:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c847afe1/0x11620bc3f30a9daa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84b4 expref: 4 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.045100:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3cb08c9/0x11620bc3f30a96db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82d1 expref: 3 pid: 13816 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.045182:0:6516:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff986fc38bc000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787787293.045195:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787293.045197:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787293.045199:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787293.045207:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787293.046348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484803072 00000100:00100000:1.0:1787787293.046360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484803072 00000100:00100000:1.0:1787787293.046416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787293.046424:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:2392:x1874630484803072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787293.046438:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787293.046453:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0030600/0x11620bc3f30a8faa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80e7 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787293.046481:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787293.046522:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2392:x1874630484803072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787293.046530:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:2.0:1787787293.053562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787293.053643:0:9030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484803584 00000100:00100000:1.0:1787787293.053654:0:9030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484803584 00000100:00100000:1.0:1787787293.053740:0:9030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:1.0:1787787293.053759:0:9030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2390:x1874630484803584:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:1.0:1787787293.053794:0:9030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a90ad 00000100:00080000:1.0:1787787293.053804:0:9030:0:(import.c:65:import_set_state_nolock()) ffff986fc3a40000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787293.053860:0:9030:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787787293.054018:0:9030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+2:2390:x1874630484803584:12345-192.168.204.31@tcp:9:umount.0 Request processed in 268us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787293.054025:0:9030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 82 00010000:00010000:2.0:1787787293.055382:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787293.055648:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787293.072470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787293.072624:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484804608 00000100:00100000:0.0:1787787293.072636:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484804608 00000100:00100000:0.0:1787787293.072719:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 258 00000100:00100000:0.0:1787787293.072730:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+22:2390:x1874630484804608:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1787787293.072784:0:7753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8ce7 00000020:00010000:0.0:1787787293.072810:0:7753:0:(genops.c:1921:obd_stale_export_put()) Put export ffff986fc38bf000: total 0 00000100:00080000:0.0:1787787293.072816:0:7753:0:(import.c:65:import_set_state_nolock()) ffff986fc38bd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787293.072845:0:7753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1787787293.073016:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99b164f2-528a-4a42-8406-031dcbc8cfdb+21:2390:x1874630484804608:12345-192.168.204.31@tcp:39:umount.0 Request processed in 286us (565us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787787293.073024:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 258 00000020:00010000:3.0:1787787293.073852:0:10345:0:(genops.c:1907:obd_stale_export_get()) Get export ffff986fc38bf000: total 0 00010000:00010000:3.0:1787787293.073908:0:10345:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff986fc38bf000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787787293.073943:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:3.0:1787787293.073946:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787293.073955:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30a9744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ed expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.073976:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787293.073978:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787293.073981:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8ac00/0x11620bc3f30a969c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82bc expref: 19 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.073993:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787293.073995:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787293.073999:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30a9a4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c83cd expref: 18 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074011:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787293.074013:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787293.074017:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ea00/0x11620bc3f30a937e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c81ea expref: 17 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074051:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc29b7d00) 00010000:00010000:3.0:1787787293.074054:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787293.074058:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454f400/0x11620bc3f30a9028 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80fc expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074076:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787293.074078:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787293.074082:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30a9c8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8467 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074093:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787293.074095:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787787293.074099:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8a200/0x11620bc3f30a96c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82ca expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074111:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff986fc29b7800) 00010000:00010000:3.0:1787787293.074114:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787293.074117:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30a900c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80f5 expref: 13 pid: 13672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074130:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9870d4cec100) 00010000:00010000:3.0:1787787293.074132:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787787293.074166:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30a9760 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c82f4 expref: 12 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074184:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff986fc2a19700) 00010000:00010000:3.0:1787787293.074186:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787293.074196:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc2a8b600/0x11620bc3f30a95bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8284 expref: 11 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074315:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787293.074319:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787787293.074324:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30a9d95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84ad expref: 10 pid: 13825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074340:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9870d974b100) 00010000:00010000:3.0:1787787293.074342:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787787293.074346:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f454ee00/0x11620bc3f30a9083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8111 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074362:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff986fc2a19a00) 00010000:00010000:3.0:1787787293.074364:0:10345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787293.074368:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc39f2200/0x11620bc3f30a9d6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c849f expref: 8 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787293.074380:0:10345:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff986fc38bf000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787787293.074395:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787293.074397:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787293.074398:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787293.089958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787293.090059:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484804736 00000100:00100000:0.0:1787787293.090069:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484804736 00000100:00100000:0.0:1787787293.090224:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 259 00000100:00100000:0.0:1787787293.090236:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+5:2390:x1874630484804736:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1787787293.090274:0:13672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8ce0 00000100:00080000:0.0:1787787293.090650:0:13672:0:(import.c:65:import_set_state_nolock()) ffff9870df55a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787293.090701:0:13672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787787293.090888:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787293.091596:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787293.092439:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99b164f2-528a-4a42-8406-031dcbc8cfdb+3:2390:x1874630484804736:12345-192.168.204.31@tcp:39:umount.0 Request processed in 2198us (2489us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787787293.092452:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 259 00000100:00100000:1.0:1787787293.359394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787293.359440:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787293.359526:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484804992 00000100:00100000:3.0:1787787293.359527:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484804864 00000100:00100000:3.0:1787787293.359539:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484804864 00000100:00100000:2.0:1787787293.359539:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484804992 00000100:00080000:1.0:1787787293.359641:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787293.359649:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787293.367784:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 361 00000100:00100000:2.0:1787787293.367818:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2391:x1874630484804864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787293.367864:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 362 00000100:00100000:1.0:1787787293.367877:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484804992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787293.367972:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2391:x1874630484804992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (8588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787293.367997:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 362 00000100:00100000:2.0:1787787293.369266:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2391:x1874630484804864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1463us (9818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787293.369277:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 361 00010000:00010000:2.0:1787787293.481366:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787294.057817:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503720448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787294.057896:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787294.058395:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720448 00000100:00100000:3.0:1787787294.058407:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720448 00000100:00100000:3.0:1787787294.058491:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787787294.058502:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503720448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787294.058535:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787294.058601:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503720448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787294.058608:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1787787294.058685:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787294.058913:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503720448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787294.059162:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787294.059174:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503720576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787294.059217:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787294.059419:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720576 00000100:00100000:3.0:1787787294.059424:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720576 00000100:00100000:3.0:1787787294.059515:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787787294.059523:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503720576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787294.059538:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787294.059586:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503720576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787294.059592:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787787294.059766:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503720576:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787787294.062718:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787294.509117:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787295.509685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787295.509738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787295.509773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787295.509821:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484805248 00000100:00100000:0.0:1787787295.509846:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484805248 00000100:00100000:3.0:1787787295.509900:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484805120 00000100:00100000:3.0:1787787295.509907:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484805120 00000100:00100000:0.0:1787787295.509910:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484805376 00000100:00100000:0.0:1787787295.509916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484805376 00000100:00100000:3.0:1787787295.509939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1787787295.510003:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+12:2391:x1874630484805248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787295.510021:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787295.510043:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6000/0x11620bc3f30a8dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8054 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787295.510060:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787295.510118:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+11:2391:x1874630484805248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 170us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787295.522447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1787787295.522492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1787787295.522508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c92d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+10:2391:x1874630484805120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787295.522532:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787295.522568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5800/0x11620bc3f30a8de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8023 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787295.522586:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787295.522663:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c92d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+9:2391:x1874630484805120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 161us (12923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787295.522671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1787787295.522812:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:3.0:1787787295.522821:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+8:2391:x1874630484805376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787295.522830:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787295.522840:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0031200/0x11620bc3f30a8fa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c80e0 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787295.522850:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787295.522866:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+7:2391:x1874630484805376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (13093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787295.522872:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:2.0:1787787295.523010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787295.523952:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484805632 00000100:00100000:3.0:1787787295.523962:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484805632 00000100:00100000:3.0:1787787295.524030:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 260 00000100:00100000:3.0:1787787295.524039:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+6:2390:x1874630484805632:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1787787295.524074:0:6528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8df8 00000020:00010000:3.0:1787787295.524081:0:6528:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9870fc316000: total 0 00000100:00080000:3.0:1787787295.524086:0:6528:0:(import.c:65:import_set_state_nolock()) ffff9870fc310800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787295.524107:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1787787295.524267:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2390:x1874630484805632:12345-192.168.204.31@tcp:39:umount.0 Request processed in 228us (1256us total) trans 4294967528 rc 0/0 00000020:00010000:1.0:1787787295.524729:0:6516:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9870fc316000: total 0 00010000:00010000:1.0:1787787295.524734:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787295.524780:0:6516:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9870fc316000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787787295.524811:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0e3eb00) 00010000:00010000:1.0:1787787295.524815:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787295.524822:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30a9db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84bb expref: 5 pid: 7753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787295.524846:0:6516:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9870fc316000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787787295.524857:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787295.524859:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787295.524860:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787295.525264:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787295.526006:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 260 00010000:00010000:2.0:1787787295.529864:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787295.537811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787295.538002:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484805760 00000100:00100000:1.0:1787787295.538014:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484805760 00000100:00100000:1.0:1787787295.538094:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 261 00000100:00100000:1.0:1787787295.538105:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+5:2390:x1874630484805760:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1787787295.538181:0:13825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8dff 00000100:00080000:1.0:1787787295.538192:0:13825:0:(import.c:65:import_set_state_nolock()) ffff9870fc311000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787295.538214:0:13825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787787295.538374:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12b28a37-797d-4b20-85b7-441f77f74f4f+3:2390:x1874630484805760:12345-192.168.204.31@tcp:39:umount.0 Request processed in 270us (571us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787787295.538411:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 261 00010000:00010000:0.0:1787787295.539096:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787295.539171:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787295.591134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787295.591246:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806016 00000100:00100000:0.0:1787787295.591256:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806016 00000100:00100000:0.0:1787787295.591311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 395 00000100:00100000:0.0:1787787295.591320:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+7:2390:x1874630484806016:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1787787295.591368:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8cbd 00000020:00010000:0.0:1787787295.591376:0:6520:0:(genops.c:1921:obd_stale_export_put()) Put export ffff986fc38bd000: total 0 00000100:00080000:0.0:1787787295.591380:0:6520:0:(import.c:65:import_set_state_nolock()) ffff986fc38b8000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787787295.591463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa4bc3ea-8edb-4d48-bc1d-b22586017753+3:2390:x1874630484806016:12345-192.168.204.31@tcp:251:umount.0 Request processed in 143us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787295.591470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 395 00000020:00010000:2.0:1787787295.591580:0:6516:0:(genops.c:1907:obd_stale_export_get()) Get export ffff986fc38bd000: total 0 00010000:00010000:2.0:1787787295.591638:0:6516:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff986fc38bd000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787787295.591686:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1390600/0x11620bc3f30a8d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8015 expref: 2 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787295.591715:0:6516:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff986fc38bd000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787787295.591726:0:6516:0:(genops.c:885:class_export_put()) final put ffff986fc38bd000/aa4bc3ea-8edb-4d48-bc1d-b22586017753 00010000:00010000:2.0:1787787295.591743:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787295.591746:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787295.591747:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787295.595575:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38bd000/aa4bc3ea-8edb-4d48-bc1d-b22586017753 for MGS 00000020:00000080:0.0:1787787295.595667:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc38b8000 for MGS 00000100:00100000:0.0:1787787296.109356:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787296.109381:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503720704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787296.109463:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.109572:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720704 00000100:00100000:1.0:1787787296.109581:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720704 00000100:00100000:1.0:1787787296.109644:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787787296.109655:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503720704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787296.109694:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787787296.109758:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503720704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.109766:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787787296.109951:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503720704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787787296.554320:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787296.617414:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503720960:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.617499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.617568:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503721600:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.617594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.617643:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503721984:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.617667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.617693:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787787296.617696:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720960 00000100:00100000:1.0:1787787296.617700:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503720832:0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.617704:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720960 00000100:00100000:1.0:1787787296.617731:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787296.617750:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721600 00000100:00100000:1.0:1787787296.617751:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503721344:0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.617753:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721600 00000100:00100000:1.0:1787787296.617770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.618090:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503721856:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.618120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.618165:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503722368:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.618200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.618230:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503721088:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.618255:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.618274:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503721472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787296.618296:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.618314:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503722112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.618335:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787296.619558:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787296.619578:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503722496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787296.619778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787296.619898:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721088 00000100:00100000:0.0:1787787296.619905:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721088 00000100:00100000:0.0:1787787296.621522:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722496 00000100:00100000:0.0:1787787296.621538:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722496 00000100:00100000:0.0:1787787296.621559:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787787296.621571:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503721088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787296.622079:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503721088:12345-0@lo:400:kworker.0 Request processed in 507us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787296.622104:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787787296.622124:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787787296.622132:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503722496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787296.622183:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787787296.622227:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503722496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787296.622233:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787787296.622291:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503722496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787296.625714:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721856 00000100:00100000:1.0:1787787296.625732:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721856 00000100:00100000:1.0:1787787296.625794:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722368 00000100:00100000:1.0:1787787296.625798:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722368 00000100:00100000:1.0:1787787296.625964:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787787296.625978:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503721856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.626065:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503721856:12345-0@lo:400:kworker.0 Request processed in 93us (7944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.626072:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787787296.626087:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787296.626093:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503722368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.626118:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503722368:12345-0@lo:400:kworker.0 Request processed in 26us (7918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.626123:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787296.626168:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721472 00000100:00100000:1.0:1787787296.626172:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721472 00000100:00100000:1.0:1787787296.626261:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787296.626268:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503721472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787296.626290:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787787296.626411:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503721472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (8113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.626417:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787296.626459:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503722624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787296.626500:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.626536:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503721088:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.626554:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503721472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787296.626575:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787787296.626581:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503721216:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.626603:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787296.626700:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721984 00000100:00100000:2.0:1787787296.626706:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721984 00000100:00100000:2.0:1787787296.626736:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721344 00000100:00100000:2.0:1787787296.626739:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721344 00000100:00100000:2.0:1787787296.626754:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722112 00000100:00100000:2.0:1787787296.626757:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722112 00000100:00100000:2.0:1787787296.626772:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787787296.626779:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503720960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.626817:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503720960:12345-0@lo:400:kworker.0 Request processed in 38us (9320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.626823:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787787296.626838:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787787296.626845:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503721600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.626887:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503721600:12345-0@lo:400:kworker.0 Request processed in 42us (9292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.626893:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787787296.626908:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787787296.626914:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503721984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.626943:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503721984:12345-0@lo:400:kworker.0 Request processed in 30us (9275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.626948:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787787296.626962:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787787296.626967:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503721344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.626993:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503721344:12345-0@lo:400:kworker.0 Request processed in 27us (9222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.626998:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787787296.627009:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787787296.627015:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.627041:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503722112:12345-0@lo:400:kworker.0 Request processed in 26us (8706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.627046:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:2.0:1787787296.627066:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787296.627070:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787296.627072:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787296.627074:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787296.633007:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722624 00000100:00100000:3.0:1787787296.633026:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722624 00000100:00100000:3.0:1787787296.633084:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787787296.633095:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503722624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787296.633125:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787787296.633229:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503722624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.633237:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000001:00100000:2.0:1787787296.634036:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00080000:2.0:1787787296.634055:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787787296.634059:0:6506:0:(genops.c:885:class_export_put()) final put ffff9870fc316000/12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00100000:2.0:1787787296.634083:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000001:00080000:2.0:1787787296.634105:0:6506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787787296.634110:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc316000/12b28a37-797d-4b20-85b7-441f77f74f4f for lustre-MDT0000 00000020:00000080:2.0:1787787296.634114:0:6506:0:(genops.c:885:class_export_put()) final put ffff986fc38bf000/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000100:00100000:1.0:1787787296.634254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503721728:0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.634286:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721216 00000100:00100000:2.0:1787787296.634291:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721216 00000100:00100000:1.0:1787787296.634298:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787296.634326:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787787296.634333:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503721216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787296.634381:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503721216:12345-0@lo:400:kworker.0 Request processed in 48us (7776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.634387:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000020:00000080:3.0:1787787296.635800:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38bf000/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-MDT0000 00000020:00000080:3.0:1787787296.635855:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc310800 for lustre-MDT0000 00000020:00000080:3.0:1787787296.635860:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc38bd800 for lustre-MDT0000 00000100:00100000:0.0:1787787296.635962:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503720832 00000100:00100000:0.0:1787787296.635970:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503720832 00000100:00100000:0.0:1787787296.636029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787787296.636038:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503720832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787296.636109:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+24:3654:x1874630503720832:12345-0@lo:400:kworker.0 Request processed in 72us (18376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787296.636116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787787296.636418:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503721728 00000100:00100000:1.0:1787787296.636423:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503721728 00000100:00100000:1.0:1787787296.636464:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787787296.636470:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503721728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.636503:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503721728:12345-0@lo:400:kworker.0 Request processed in 34us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.636509:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787787296.636528:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787296.636557:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503721728:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.636568:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503722240:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.636594:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787296.637451:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722240 00000100:00100000:1.0:1787787296.637459:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722240 00000100:00100000:0.0:1787787296.637509:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503720832:0@lo:400:kworker.0 00000100:00100000:0.0:1787787296.637531:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503721344:0@lo:400:kworker.0 00000100:00100000:0.0:1787787296.637543:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503721856:0@lo:400:kworker.0 00000100:00100000:0.0:1787787296.637555:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503722368:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.637562:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787787296.637567:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503720960:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.637571:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503722240:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787787296.637580:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f2940 x1874630503721600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787296.637608:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503721600:0@lo:400:kworker.0 00000100:00100000:0.0:1787787296.637848:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503721984:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.638063:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503722240:12345-0@lo:400:kworker.0 Request processed in 493us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.638071:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787787296.638100:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503722240:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.638120:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503722624:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787787296.638345:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4899e00 x1874630503722112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787296.638356:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503722112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787296.638383:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503721216:0@lo:400:kworker.0 00000020:01000004:1.0:1787787297.565224:0:15160:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:2.0:1787787297.578224:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787787297.579335:0:15160:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787787297.579393:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.579408:0:15160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.579415:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.579422:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.579455:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787787297.579461:0:15160:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787787297.579505:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787297.579513:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787297.579521:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1390400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787297.579525:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787297.579534:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787297.579541:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787297.579546:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1787787297.579560:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:3.0:1787787297.579564:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:2.0:1787787297.579564:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:01000000:3.0:1787787297.579566:0:6516:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1787787297.579569:0:15160:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787787297.579592:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870df5f5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787787297.579594:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787297.579600:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787297.579628:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787297.579637:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c1390400/0x11620bc3f30a8d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787297.579645:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787787297.579651:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787297.579653:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787297.579655:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787297.579704:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503722752:0@lo:39:umount.0 00000100:00100000:0.0:1787787297.579777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787297.579884:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722752 00000100:00100000:3.0:1787787297.579891:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722752 00000100:00100000:2.0:1787787297.579894:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503722880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787297.579926:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787297.579962:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503722880 00000100:00100000:2.0:1787787297.579966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503722880 00000100:00100000:3.0:1787787297.579991:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787787297.579998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787297.580000:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874630503722752:12345-0@lo:39:umount.0 00000100:00100000:2.0:1787787297.580004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3655:x1874630503722880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787297.580016:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1787787297.580023:0:6528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a88d4 00010000:00010000:2.0:1787787297.580030:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c7e00/0x11620bc3f30a8d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d73 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787787297.580031:0:6528:0:(import.c:65:import_set_state_nolock()) ffff9870d2377800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787787297.580044:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787297.580077:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3652:x1874630503722752:12345-0@lo:39:umount.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787297.580077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+23:3655:x1874630503722880:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787297.580085:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787787297.580085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:3.0:1787787297.580095:0:6528:0:(genops.c:885:class_export_put()) final put ffff9870d2373800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1787787297.580573:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503722880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787297.580618:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787297.580644:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870df5f5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787787297.580654:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503722752:0@lo:39:umount.0 00000100:00080000:2.0:1787787297.581602:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787297.581618:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787297.581624:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787787297.583395:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.583414:0:15160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584285:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584293:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584311:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787297.584318:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584325:0:15160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584331:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584331:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787297.584337:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584339:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584347:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454f200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787297.584351:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584356:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787297.584360:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584362:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584369:0:15160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787297.584369:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584376:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787297.584377:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787297.584380:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787787297.584393:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584405:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787297.584413:0:10345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584415:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787297.584419:0:10345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787297.584420:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584425:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454f000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787297.584429:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584455:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584462:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454f200/0x11620bc3f30a8d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584481:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787297.584484:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584490:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787297.584493:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584499:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787297.584506:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787297.584511:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787787297.584513:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787787297.584516:0:10345:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787787297.584531:0:10345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584538:0:10345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787297.584544:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584551:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30a8fdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8fe2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.584562:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787297.584564:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787297.584572:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787297.584590:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503723008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787297.584675:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787297.584722:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787297.584730:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503723136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787297.584752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787297.584785:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723008 00010000:00010000:2.0:1787787297.584787:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.584791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723008 10000000:00010000:2.0:1787787297.584794:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787297.584799:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787297.584800:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787787297.584802:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787787297.584816:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584822:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787787297.584829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723136 00000100:00100000:0.0:1787787297.584832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723136 00010000:00010000:2.0:1787787297.584836:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584843:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454f000/0x11620bc3f30a8c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8c7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.584847:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787297.584855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+24:3653:x1874630503723008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787297.584857:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787297.584858:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787297.584860:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787297.584867:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787787297.584869:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503723264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787297.584882:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391400/0x11620bc3f30a8d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d81 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787297.584894:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787297.584894:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787297.584920:0:15160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.584924:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+23:3653:x1874630503723008:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (250us total) trans 0 rc 0/0 00010000:00010000:2.0:1787787297.584928:0:15160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.584931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787787297.584934:0:15160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.584940:0:15160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.584945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723264 00000100:00100000:0.0:1787787297.584948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723264 00010000:00010000:2.0:1787787297.584951:0:15160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787787297.584954:0:15160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787787297.584957:0:15160:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1787787297.584961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787297.584966:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+23:3653:x1874630503723136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787297.584972:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787297.584981:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8b400/0x11620bc3f30a8fe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8fdb expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787787297.584988:0:15160:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1787787297.584989:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000000:2.0:1787787297.584992:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787787297.584996:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787297.585001:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:2.0:1787787297.585006:0:15160:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff986fc2a07000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787297.585012:0:15160:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9870f4592800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1787787297.585014:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+22:3653:x1874630503723136:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (261us total) trans 0 rc 0/0 00000020:00080000:2.0:1787787297.585017:0:15160:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9870f576f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1787787297.585021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00080000:2.0:1787787297.585029:0:15160:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9870f4591000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000100:00100000:0.0:1787787297.585032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000020:00080000:2.0:1787787297.585034:0:15160:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9870d22f3370) has exports, disconnecting them 00000100:00100000:0.0:1787787297.585037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+21:3655:x1874630503723264:12345-0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787787297.585039:0:15160:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff986fc2a07000), last request at 1787787296 00000020:00000080:2.0:1787787297.585045:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8beb 00010000:00010000:0.0:1787787297.585045:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787297.585053:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391800/0x11620bc3f30a8c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8c77 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.585061:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1787787297.585063:0:15160:0:(import.c:65:import_set_state_nolock()) ffff986fc2a02800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787787297.585083:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+20:3655:x1874630503723264:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787297.585089:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1787787297.585105:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787297.585109:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.585114:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787297.585117:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.585118:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503723264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787297.585125:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787297.585131:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787297.585172:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503723136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787297.585180:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503723008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787297.585192:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787787297.585272:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787297.585276:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787787297.585277:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787787297.585293:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.585298:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787297.585315:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.585322:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c6600/0x11620bc3f30a8833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a883a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787297.585338:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787297.585340:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787297.585342:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787787297.585359:0:15160:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc2a07000): rc 0 00000020:00000080:2.0:1787787297.585362:0:15160:0:(genops.c:885:class_export_put()) final put ffff986fc2a07000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787787297.585369:0:15160:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9870f4592800), last request at 1787787296 00000020:00000080:2.0:1787787297.585372:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8abe 00000100:00080000:2.0:1787787297.585378:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870f4597800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787787297.585386:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503723392:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787787297.585389:0:15160:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f4592800): rc 0 00000020:00000080:2.0:1787787297.585392:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870f4592800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787787297.585396:0:15160:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9870f576f000), last request at 1787787066 00000020:00000080:2.0:1787787297.585399:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a89bb 00000100:00080000:2.0:1787787297.585402:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870f5768800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787787297.585412:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787297.585415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787787297.585419:0:15160:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f576f000): rc 0 00000020:00000080:2.0:1787787297.585421:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870f576f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787787297.585425:0:15160:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9870f4591000), last request at 1787787066 00000020:00000080:2.0:1787787297.585428:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a898a 00000100:00080000:2.0:1787787297.585446:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870f576d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787787297.585458:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787297.585528:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787297.585536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723392 00000100:00100000:0.0:1787787297.585540:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723392 00000100:00100000:0.0:1787787297.585565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787297.585571:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+20:3656:x1874630503723392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787297.585579:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787297.585588:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14600/0x11620bc3f30a883a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8833 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787297.585616:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787297.585643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:697ab143-19fe-4215-afba-68a282afbaf6+19:3656:x1874630503723392:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787297.585649:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787297.585674:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503723392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787297.585771:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787787297.585781:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d2373800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787787297.585827:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a07000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787787297.585847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4592800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787787297.585862:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f576f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787787297.585891:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870d2377800 for lustre-MDT0000 00000020:00000080:3.0:1787787297.585895:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc2a02800 for lustre-MDT0000 00000020:00000080:3.0:1787787297.585899:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f4597800 for lustre-MDT0000 00000020:00000080:3.0:1787787297.585903:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f5768800 for lustre-MDT0000 00000001:00000004:2.0:1787787297.586746:0:15160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1787787297.586856:0:15160:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f4591000): rc 0 00000004:00000080:2.0:1787787297.586864:0:15160:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa62241547ae0 00000100:00080000:2.0:1787787297.586884:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787787297.586888:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1787787297.589286:0:15160:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787787297.589320:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870f5601800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787787297.589570:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503723520:0@lo:39:umount.0 00000100:00100000:0.0:1787787297.589656:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787297.589746:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723520 00000100:00100000:3.0:1787787297.589754:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723520 00000100:00080000:2.0:1787787297.589792:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787297.589796:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00100000:3.0:1787787297.589808:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000004:00080000:2.0:1787787297.589809:0:15160:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787297.589817:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874630503723520:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787787297.589848:0:6532:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8a2b 00000100:00080000:3.0:1787787297.589858:0:6532:0:(import.c:65:import_set_state_nolock()) ffff9870fc17d800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787787297.589869:0:15160:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787787297.589880:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870fc38e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000001:00000004:3.0:1787787297.589883:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1787787297.589887:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787297.589889:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787787297.589895:0:15160:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787787297.589950:0:15160:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787787297.589958:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870fc388000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787787297.590007:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3652:x1874630503723520:12345-0@lo:39:umount.0 Request processed in 192us (351us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787787297.590014:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000020:00080000:2.0:1787787297.590025:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9870d22f3370) has no exports 00010000:00010000:3.0:1787787297.590038:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787297.590086:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503723648:0@lo:9:umount.0 00000100:00100000:0.0:1787787297.590116:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787297.590164:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503723776:0@lo:9:umount.0 00000100:00100000:0.0:1787787297.590187:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787297.590221:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f5601800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787787297.590227:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503723520:0@lo:39:umount.0 00000100:00100000:0.0:1787787297.590246:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723648 00000100:00100000:0.0:1787787297.590249:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723648 00000100:00100000:0.0:1787787297.590275:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723776 00000100:00100000:0.0:1787787297.590278:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723776 00000100:00100000:0.0:1787787297.590296:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787297.590303:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874630503723648:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787787297.590318:0:8444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b66 00000100:00080000:0.0:1787787297.590324:0:8444:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787297.590355:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787787297.590447:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3652:x1874630503723648:12345-0@lo:9:umount.0 Request processed in 133us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787297.590454:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787297.590479:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787787297.590484:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874630503723776:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787787297.590497:0:8444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8cb6 00000100:00080000:0.0:1787787297.590501:0:8444:0:(import.c:65:import_set_state_nolock()) ffff986fc372a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787297.590521:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787787297.590588:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3652:x1874630503723776:12345-0@lo:9:umount.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787297.590595:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1787787297.590641:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787297.590658:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc38e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787787297.590666:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787787297.590668:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787297.590671:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503723648:0@lo:9:umount.0 00000100:00080000:0.0:1787787297.590680:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc388000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787787297.590687:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787787297.590688:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787297.590690:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503723776:0@lo:9:umount.0 00010000:00010000:3.0:1787787297.590812:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787787297.606828:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9870d22f3370) has no exports 00000020:00000080:2.0:1787787297.672908:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a888e 00000020:00000080:2.0:1787787297.672924:0:15160:0:(genops.c:885:class_export_put()) final put ffff987101cc5000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787787297.672985:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787787297.673125:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787297.673162:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787297.673167:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9870d155cd28) has no exports 00000020:00000080:3.0:1787787297.673455:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8887 00000020:00000080:3.0:1787787297.673461:0:15160:0:(genops.c:885:class_export_put()) final put ffff987101cc3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787787297.675075:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff987101cc5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787787297.675327:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff987101cc3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787297.675407:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787297.675419:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787787297.675424:0:15160:0:(genops.c:885:class_export_put()) final put ffff987101cc4800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787787297.675427:0:15160:0:(genops.c:844:class_export_destroy()) destroying export ffff987101cc4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787787297.675715:0:15160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787787298.601411:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787787298.667499:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787787298.667508:0:8436:0:(genops.c:885:class_export_put()) final put ffff9870ff9bf000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787787298.667531:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:2.0:1787787298.667534:0:8436:0:(genops.c:885:class_export_put()) final put ffff986fc3a44000/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:3.0:1787787298.668933:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ff9bf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787787298.668997:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc3a44000/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-OST0000 00000020:00000080:3.0:1787787298.669015:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870ff9bd000 for lustre-OST0000 00000020:00000080:3.0:1787787298.669036:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc3a40000 for lustre-OST0000 00000001:00100000:1.0:1787787298.670306:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787298.670314:0:9520:0:(genops.c:885:class_export_put()) final put ffff986fc372b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787787298.670385:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:1.0:1787787298.670388:0:9520:0:(genops.c:885:class_export_put()) final put ffff986fc38bc000/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:2.0:1787787298.670697:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc372b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787787298.670748:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc372a000 for lustre-OST0001 00000001:00100000:3.0:1787787298.672397:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787787298.672413:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787787298.672418:0:7458:0:(genops.c:885:class_export_put()) final put ffff9870f5769800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787787298.672438:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00080000:3.0:1787787298.672445:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787787298.672447:0:7458:0:(genops.c:885:class_export_put()) final put ffff9870fc312800/12b28a37-797d-4b20-85b7-441f77f74f4f 00000001:00100000:3.0:1787787298.672452:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 99b164f2-528a-4a42-8406-031dcbc8cfdb 00000001:00080000:3.0:1787787298.672456:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787787298.672457:0:7458:0:(genops.c:885:class_export_put()) final put ffff986fc2a14000/99b164f2-528a-4a42-8406-031dcbc8cfdb 00000020:00000080:2.0:1787787298.672576:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5769800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787787298.680511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc312800/12b28a37-797d-4b20-85b7-441f77f74f4f for lustre-MDT0001 00000020:00000080:2.0:1787787298.680644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a14000/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-MDT0001 00000020:00000080:2.0:1787787298.681042:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc17d800 for lustre-MDT0001 00000020:00000080:2.0:1787787298.681050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38bc000/99b164f2-528a-4a42-8406-031dcbc8cfdb for lustre-OST0001 00000020:00000080:2.0:1787787298.686125:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc311000 for lustre-MDT0001 00000020:00000080:2.0:1787787298.686152:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870df55a000 for lustre-MDT0001 00000020:00000080:2.0:1787787298.686173:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c3e9c800 for lustre-OST0001 00000100:00100000:1.0:1787787299.178272:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787299.178295:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503723904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787299.178366:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787299.178447:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503723904 00000100:00100000:3.0:1787787299.178457:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503723904 00000100:00100000:3.0:1787787299.178547:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787787299.178560:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503723904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787299.178608:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787787299.178666:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503723904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787299.178673:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787787299.178745:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787299.179221:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503723904:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787787299.627099:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787300.137868:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787787300.653275:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787301.673370:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787301.737552:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503724416:0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.737630:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787301.737697:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503724928:0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.737721:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787301.737766:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787787301.737773:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503724032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.737803:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787301.737824:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503724544:0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.737845:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787301.737860:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503725056:0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.737894:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787301.737928:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724032 00000100:00100000:1.0:1787787301.737937:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724032 00000100:00100000:1.0:1787787301.737982:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787787301.737992:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+19:3653:x1874630503724032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.738041:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:697ab143-19fe-4215-afba-68a282afbaf6+19:3653:x1874630503724032:12345-0@lo:400:kworker.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787301.738048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787787301.738075:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725056 00000100:00100000:1.0:1787787301.738079:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725056 00000100:00100000:1.0:1787787301.738123:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787787301.738129:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503725056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.738181:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503725056:12345-0@lo:400:kworker.0 Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787301.738187:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1787787301.738204:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787301.738228:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503724032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787301.738241:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503725056:0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.738733:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724416 00000100:00100000:0.0:1787787301.738739:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724416 00000100:00100000:0.0:1787787301.738771:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724928 00000100:00100000:0.0:1787787301.738775:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724928 00000100:00100000:0.0:1787787301.738833:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724544 00000100:00100000:0.0:1787787301.738836:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724544 00000100:00100000:0.0:1787787301.738858:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787787301.738865:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503724928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.738921:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503724928:12345-0@lo:400:kworker.0 Request processed in 56us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787301.738938:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787787301.738955:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787787301.738961:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503724544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.738990:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503724544:12345-0@lo:400:kworker.0 Request processed in 30us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787301.738996:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787787301.739008:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787787301.739011:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3653:x1874630503724416:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787787301.739017:0:13672:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787787301.739041:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3653:x1874630503724416:12345-0@lo:400:kworker.0 Request processed in 27us (1412us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787787301.739046:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1787787301.739072:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787301.739089:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503724160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.739134:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787301.739176:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503724672:0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.739198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787301.739219:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787787301.739226:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503724288:0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.739246:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787301.739263:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503724800:0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.739283:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787301.739308:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724672 00000100:00100000:0.0:1787787301.739312:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724672 00000100:00100000:0.0:1787787301.739345:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787301.739359:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503724672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.739395:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503724672:12345-0@lo:400:kworker.0 Request processed in 38us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787301.739402:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787301.739421:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724288 00000100:00100000:0.0:1787787301.739425:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724288 00000100:00100000:0.0:1787787301.739455:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724800 00000100:00100000:0.0:1787787301.739458:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724800 00000100:00100000:0.0:1787787301.739471:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787787301.739475:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1874630503724288:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787787301.739480:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787787301.739505:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1874630503724288:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787787301.739511:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787787301.739522:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787787301.739539:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1874630503724800:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787787301.739543:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787787301.739566:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1874630503724800:12345-0@lo:400:kworker.0 Request processed in 26us (282us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787787301.739572:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1787787301.739585:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787301.739644:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787787301.739649:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787787301.739652:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787787301.740688:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503724160 00000100:00100000:3.0:1787787301.740697:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503724160 00000100:00100000:3.0:1787787301.740736:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787787301.740742:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3655:x1874630503724160:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787787301.740749:0:6532:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787787301.740796:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3655:x1874630503724160:12345-0@lo:400:kworker.0 Request processed in 53us (1661us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787787301.740802:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787787301.741309:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787301.741323:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503725184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787301.741363:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787301.741448:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725184 00000100:00100000:2.0:1787787301.741453:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725184 00000100:00100000:2.0:1787787301.741490:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787787301.741496:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503725184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787787301.741521:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787787301.741571:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503725184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787301.741577:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787787301.741617:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503725184:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787787301.741871:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b2580 x1874630503724544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787301.741908:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503724544:0@lo:400:kworker.0 00000100:00080000:1.0:1787787301.741922:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787787301.741927:0:3653:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787787301.741930:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787787301.741935:0:3653:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787301.741939:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 229 00000100:00080000:1.0:1787787301.741944:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc2761000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787301.741960:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc43f0780 x1874630503725440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787301.741988:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503724416:0@lo:400:kworker.0 00010000:00080000:1.0:1787787301.742001:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b0000 x1874630503724928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787301.742009:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503724928:0@lo:400:kworker.0 00000100:00100000:3.0:1787787301.742077:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503725440:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787787301.742120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787301.742329:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725440 00000100:00100000:1.0:1787787301.742335:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725440 00000100:00100000:1.0:1787787301.742368:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787787301.742373:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503725440:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787787301.742387:0:6527:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787787301.742445:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503725312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787301.742475:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787301.742505:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725312 00000100:00100000:2.0:1787787301.742508:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725312 00000100:00100000:2.0:1787787301.742540:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787787301.742544:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874630503725312:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787787301.742549:0:6532:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787787301.742580:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874630503725312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 34us (103us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787301.742585:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:02020000:2.0:1787787301.742612:0:3656:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787787301.742621:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787787301.742624:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787787301.742627:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787787301.742638:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787301.742642:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:2.0:1787787301.742646:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9870f5607000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787301.742663:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc400d680 x1874630503725568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787301.742686:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503725568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787787301.742707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787301.742725:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725568 00000100:00100000:2.0:1787787301.742728:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725568 00000100:00100000:2.0:1787787301.742741:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787787301.742745:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503725568:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787787301.742752:0:6532:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787787301.742774:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503725568:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28us (66us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787301.742779:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1787787301.742798:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787301.742802:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787301.742805:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503725568:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1787787301.770795:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787301.770805:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:0.0:1787787301.770814:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9870fc07f000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787301.770872:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed9252c0 x1874630503725696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787301.770910:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503724288:0@lo:400:kworker.0 00000100:00080000:0.0:1787787301.770947:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787787301.770951:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787787301.770954:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787787301.770958:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787301.770961:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 250 00000100:00080000:0.0:1787787301.770965:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9870fc113800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787301.770976:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed9270c0 x1874630503725824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787301.770987:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503724800:0@lo:400:kworker.0 00000100:00080000:0.0:1787787301.771000:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787787301.771003:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9870f5607000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:0.0:1787787301.771006:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503724160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787301.771022:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503724672:0@lo:400:kworker.0 00000100:00100000:2.0:1787787301.775224:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503725696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787787301.775311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787301.775374:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503725824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787787301.775399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787301.775612:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725696 00000100:00100000:3.0:1787787301.775631:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725696 00000100:00100000:3.0:1787787301.775676:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725824 00000100:00100000:3.0:1787787301.775680:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725824 00000100:00100000:3.0:1787787301.775701:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787787301.775709:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1874630503725696:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787787301.775728:0:13825:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787301.775779:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1874630503725696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 70us (469us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787301.775787:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787787301.775802:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787787301.775806:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1874630503725824:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787787301.775813:0:13825:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787301.775836:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1874630503725824:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29us (437us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787301.775842:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1787787301.776181:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787301.776186:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787301.776207:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503725696:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787787301.776221:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787301.776225:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787301.776228:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503725824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787787301.797898:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503725440:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 55511us (55765us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787787301.797915:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1787787301.797964:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787301.797971:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787301.797976:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503725440:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787787302.701311:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787303.723240:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787787303.790346:0:6506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787787303.790356:0:6506:0:(genops.c:885:class_export_put()) final put ffff9870f4591000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787787303.790498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4591000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787787303.790562:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f576d000 for lustre-MDT0000 00000100:00100000:1.0:1787787304.297428:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503725952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787304.297528:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787304.297689:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503725952 00000100:00100000:0.0:1787787304.297698:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503725952 00000100:00100000:0.0:1787787304.297772:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787304.297782:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503725952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787304.297819:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787787304.297876:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503725952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787304.297883:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787787304.298004:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503725952:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787787304.298073:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787304.745356:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787305.769622:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787306.793378:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787306.857496:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503726080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787306.857579:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787306.858808:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726080 00000100:00100000:3.0:1787787306.858822:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726080 00000100:00100000:3.0:1787787306.858934:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787787306.858944:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503726080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787306.858976:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1787787306.859242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787306.859246:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787306.859251:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787306.859257:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787787306.859262:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787306.859267:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9870f5607000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787306.859291:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3b21c0 x1874630503726336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787306.859306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787306.859309:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787306.859311:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787306.859315:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787787306.859317:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787306.859320:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9870fc07f000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787306.859329:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3b03c0 x1874630503726464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787306.859337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787306.859340:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787306.859342:0:8:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787306.859345:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787787306.859347:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787306.859349:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc2761000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787306.859357:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3b3480 x1874630503726592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787306.861033:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503726208:0@lo:400:kworker.0 00000100:00100000:0.0:1787787306.861104:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787306.861178:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726208 00000100:00100000:0.0:1787787306.861185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726208 00000100:00100000:0.0:1787787306.861227:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787787306.861235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+19:3655:x1874630503726208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787306.861277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:697ab143-19fe-4215-afba-68a282afbaf6+19:3655:x1874630503726208:12345-0@lo:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787306.861283:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787787306.861327:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503726208:0@lo:400:kworker.0 00000100:00080000:1.0:1787787306.861587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787306.861591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787306.861594:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787306.861599:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787787306.861602:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787306.861607:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9870fc113800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787306.861626:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3b0b40 x1874630503726976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787306.861663:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503726848:0@lo:400:kworker.0 00000100:00100000:1.0:1787787306.861705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787306.861733:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787306.861738:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503727104:0@lo:400:kworker.0 00000100:00100000:1.0:1787787306.861762:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787306.861786:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787306.861793:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503726720:0@lo:400:kworker.0 00000100:00100000:1.0:1787787306.861819:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787306.861949:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787306.861971:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727104 00000100:00100000:1.0:1787787306.861976:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727104 00000100:00100000:1.0:1787787306.862017:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726720 00000100:00100000:1.0:1787787306.862021:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726720 00000100:00100000:2.0:1787787306.862235:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503726336:0@lo:38:kworker.0 00000100:00100000:1.0:1787787306.862299:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787787306.862306:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503727104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787306.862331:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726848 00000100:00100000:0.0:1787787306.862335:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726848 00000100:00100000:0.0:1787787306.862365:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787787306.862372:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503726848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787306.864932:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503726080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5977us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787306.864948:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787787306.865012:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787787306.865026:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503726720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787306.865103:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503726720:12345-0@lo:400:kworker.0 Request processed in 83us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787306.865110:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00080000:3.0:1787787306.865178:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b0f00 x1874630503726720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787306.865195:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503726720:0@lo:400:kworker.0 00000100:00100000:3.0:1787787306.865245:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503726080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787306.865955:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503726848:0@lo:400:kworker.0 00000100:00100000:1.0:1787787306.866064:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503727104:12345-0@lo:400:kworker.0 Request processed in 3757us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787306.866089:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:1.0:1787787306.866114:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787306.866120:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787787306.866180:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b2580 x1874630503727104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787306.866191:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503727104:0@lo:400:kworker.0 00000100:00100000:0.0:1787787306.866262:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503726848:12345-0@lo:400:kworker.0 Request processed in 3889us (4566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787306.866271:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787787306.868954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787306.869013:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503726464:0@lo:38:kworker.0 00000100:00100000:0.0:1787787306.869218:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726336 00000100:00100000:0.0:1787787306.869240:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726336 00000100:00100000:0.0:1787787306.869280:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787787306.869287:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503726336:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787787306.869306:0:6532:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787787306.869535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787306.870597:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503726592:0@lo:38:kworker.0 00000100:00100000:2.0:1787787306.870650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787306.872598:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503726976:0@lo:38:kworker.0 00000100:00100000:2.0:1787787306.872664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787306.872719:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726464 00000100:00100000:3.0:1787787306.872727:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726464 00000100:00100000:3.0:1787787306.872768:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726592 00000100:00100000:3.0:1787787306.872771:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726592 00000100:00100000:3.0:1787787306.872812:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787787306.872820:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874630503726464:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787787306.872839:0:13672:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787306.872893:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874630503726464:12345-0@lo:38:kworker.0 Request processed in 73us (3357us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787306.872901:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787787306.872918:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787787306.872922:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874630503726592:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787787306.872929:0:13672:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787306.872952:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874630503726592:12345-0@lo:38:kworker.0 Request processed in 29us (2302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787306.872958:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1787787306.873536:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787306.873542:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787306.873546:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503726464:0@lo:38:kworker.0 00000100:00080000:2.0:1787787306.873557:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787306.873561:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787306.873564:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503726592:0@lo:38:kworker.0 00000100:00100000:3.0:1787787306.874244:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503726976 00000100:00100000:3.0:1787787306.874251:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503726976 00000100:00100000:3.0:1787787306.874288:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787787306.874295:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503726976:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787787306.874309:0:6528:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787306.874368:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503726976:12345-0@lo:38:kworker.0 Request processed in 71us (1703us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787306.874387:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1787787306.874420:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787306.874437:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787306.874441:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503726976:0@lo:38:kworker.0 00000100:00100000:0.0:1787787306.879838:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503726336:12345-0@lo:38:kworker.0 Request processed in 10542us (10883us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787787306.879853:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1787787306.881654:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787306.881682:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787306.881688:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503726336:0@lo:38:kworker.0 00010000:00010000:3.0:1787787307.818313:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787308.841340:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787309.417396:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503727232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787309.417474:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787309.417632:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727232 00000100:00100000:2.0:1787787309.417641:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727232 00000100:00100000:2.0:1787787309.417705:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787787309.417715:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503727232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787309.417762:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787787309.417819:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503727232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787309.417829:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787787309.417838:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787309.417973:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503727232:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787787309.865378:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787310.378336:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787787310.890901:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787311.913410:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787311.977354:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787311.977362:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787311.977366:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787311.977374:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787787311.977380:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787787311.977387:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9870f5607000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787311.977409:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f6580 x1874630503727488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787311.977428:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787311.977432:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787311.977434:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787311.977437:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787787311.977439:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787787311.977442:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9870fc07f000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787311.977453:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f52c0 x1874630503727616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787311.977460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787311.977463:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787311.977465:0:38:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787311.977469:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787787311.977486:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787787311.977489:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc2761000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787311.977501:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f43c0 x1874630503727744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787311.977528:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787311.977531:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787311.977533:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787311.977536:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1787787311.977538:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787787311.977541:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9870fc113800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787311.977551:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f4b40 x1874630503728128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787311.977704:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503728256:0@lo:400:kworker.0 00000100:00100000:0.0:1787787311.977772:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787311.977826:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787787311.977833:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503727360:0@lo:400:kworker.0 00000100:00100000:0.0:1787787311.977863:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787311.977884:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503728384:0@lo:400:kworker.0 00000100:00100000:0.0:1787787311.977905:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787311.977936:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728384 00000100:00100000:0.0:1787787311.977943:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728384 00000100:00100000:0.0:1787787311.978000:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787787311.978011:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503728384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787311.978061:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503728384:12345-0@lo:400:kworker.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787311.978069:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787787311.978114:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503728384:0@lo:400:kworker.0 00000100:00080000:1.0:1787787311.978216:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787311.978450:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503727872:0@lo:400:kworker.0 00000100:00100000:3.0:1787787311.978484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787311.978506:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787311.978512:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503728000:0@lo:400:kworker.0 00000100:00100000:3.0:1787787311.978532:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787311.978562:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728256 00000100:00100000:3.0:1787787311.978566:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728256 00000100:00100000:3.0:1787787311.978709:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727872 00000100:00100000:3.0:1787787311.978713:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727872 00000100:00100000:3.0:1787787311.978734:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787787311.978741:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503728256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787311.978778:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503728256:12345-0@lo:400:kworker.0 Request processed in 38us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787311.978784:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787787311.978796:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787787311.978802:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503727872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787311.978831:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503727872:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787311.978837:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787787311.978855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727360 00000100:00100000:3.0:1787787311.978858:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727360 00000100:00100000:3.0:1787787311.978879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787787311.978885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:3655:x1874630503727360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787311.978912:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d22c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:697ab143-19fe-4215-afba-68a282afbaf6+19:3655:x1874630503727360:12345-0@lo:400:kworker.0 Request processed in 27us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787311.978928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787787311.978958:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728000 00000100:00100000:3.0:1787787311.978962:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728000 00000100:00100000:3.0:1787787311.978986:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787311.978993:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503728000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787311.979022:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503728000:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787311.979028:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1787787311.979049:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787311.979053:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787311.979069:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503728000:0@lo:400:kworker.0 00010000:00080000:3.0:1787787311.979080:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f61c0 x1874630503727872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787311.979090:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503727872:0@lo:400:kworker.0 00000100:00100000:2.0:1787787311.979225:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503727488:0@lo:38:kworker.0 00000100:00100000:2.0:1787787311.979261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787311.979289:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503727616:0@lo:38:kworker.0 00000100:00100000:2.0:1787787311.979311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787311.979341:0:7753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727616 00000100:00100000:2.0:1787787311.979345:0:7753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727616 00000100:00100000:2.0:1787787311.979367:0:7753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787787311.979372:0:7753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874630503727616:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787787311.979387:0:7753:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787311.980165:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727488 00000100:00100000:3.0:1787787311.980171:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727488 00000100:00100000:3.0:1787787311.980198:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787787311.980203:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503727488:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787787311.980211:0:6532:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787311.980254:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503727488:12345-0@lo:38:kworker.0 Request processed in 49us (991us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787311.980260:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787787311.980294:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503727744:0@lo:38:kworker.0 00000100:00100000:3.0:1787787311.980320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787311.980355:0:13672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503727744 00000100:00100000:3.0:1787787311.980368:0:13672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503727744 00000100:00100000:3.0:1787787311.980388:0:13672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787787311.980392:0:13672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874630503727744:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787787311.980399:0:13672:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787311.980428:0:13672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1874630503727744:12345-0@lo:38:kworker.0 Request processed in 35us (108us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787311.980434:0:13672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:3.0:1787787311.980461:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787311.980465:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787311.980469:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503727744:0@lo:38:kworker.0 00000100:00100000:3.0:1787787311.980475:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503728128:0@lo:38:kworker.0 00000100:00100000:3.0:1787787311.980495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787311.980512:0:13825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728128 00000100:00100000:3.0:1787787311.980514:0:13825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728128 00000100:00100000:3.0:1787787311.980529:0:13825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787787311.980533:0:13825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1874630503728128:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787787311.980540:0:13825:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787311.980560:0:13825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3652:x1874630503728128:12345-0@lo:38:kworker.0 Request processed in 26us (64us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787311.980566:0:13825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787787311.980719:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787311.980728:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503728512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787311.980763:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787311.980788:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728512 00000100:00100000:0.0:1787787311.980791:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728512 00000100:00100000:0.0:1787787311.980817:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787787311.980823:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503728512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787311.980844:0:10154:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787787311.980877:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503728512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787311.980883:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787787311.980914:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503728512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787311.980941:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503727360:0@lo:400:kworker.0 00010000:00080000:0.0:1787787311.980953:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3f6d00 x1874630503728256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787311.980964:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503728256:0@lo:400:kworker.0 00000020:02000400:1.0:1787787311.981081:0:15160:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 4. Is it stuck? 00000100:00080000:3.0:1787787311.981109:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787311.981113:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787311.981117:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503728128:0@lo:38:kworker.0 00000100:00080000:3.0:1787787311.981162:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787311.981166:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787311.981169:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503727488:0@lo:38:kworker.0 00000100:00100000:2.0:1787787311.983555:0:7753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1874630503727616:12345-0@lo:38:kworker.0 Request processed in 4178us (4239us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787311.983570:0:7753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:0.0:1787787311.983801:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787311.983807:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787787311.983812:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503727616:0@lo:38:kworker.0 00000020:01000000:1.0:1787787312.001888:0:15160:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc3916840 - data ffff986fc2037e58/ffff986fc3b7b800 00000020:01000000:1.0:1787787312.002059:0:15160:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff987101d2ba80 - data ffff9870f056ae58/ffff987101cd5000 00000001:00000004:1.0:1787787312.010766:0:15160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1787787312.092476:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787787312.092487:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787787312.092506:0:15160:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff986fc36ee1c0 x1874630503723520/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787787307 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787312.092532:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787787312.098902:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787787312.098910:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787787312.098943:0:15160:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787312.098946:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787787312.099677:0:9028:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787787312.099683:0:9028:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787787312.099699:0:9028:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787787312.100430:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787787312.100435:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787787312.100444:0:15160:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787312.100446:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787787312.100885:0:9847:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787787312.100890:0:9847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787787312.100901:0:9847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787787312.102794:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8856 00000020:00000080:3.0:1787787312.102810:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f6800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787787312.103740:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787312.111294:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a886b 00000020:00000080:3.0:1787787312.111311:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787787312.111320:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787787312.111337:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787312.111346:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787312.111350:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9870d22f4d28) has no exports 00000004:01000000:3.0:1787787312.111525:0:15160:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787787312.111534:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8ca1 00000020:00000080:3.0:1787787312.111539:0:15160:0:(genops.c:885:class_export_put()) final put ffff986fc38b9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787787312.111543:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787787312.111546:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787312.111555:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787312.111557:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff986fc38c4d28) has no exports 00000020:00000080:3.0:1787787312.111564:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8c9a 00000020:00000080:3.0:1787787312.111567:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870fc38d800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787787312.111918:0:15160:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787787312.111936:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787787312.111941:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787787312.111947:0:15160:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787312.111949:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787312.111980:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787312.111988:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787312.112004:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b5f 00000020:00000080:3.0:1787787312.112009:0:15160:0:(genops.c:885:class_export_put()) final put ffff986fc2a00000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787787312.112012:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787787312.112015:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787312.112019:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787312.112022:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9870fc368000) has no exports 00000020:00000080:3.0:1787787312.112026:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b58 00000020:00000080:3.0:1787787312.112028:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870fc38b000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787787312.112411:0:15160:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787787312.112415:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787787312.112416:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1787787312.112420:0:15160:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787312.112421:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787312.112443:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787312.112449:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787787312.112459:0:15160:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787787312.112463:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8a24 00000020:00000080:3.0:1787787312.112469:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870fc28f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787787312.112472:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787787312.112476:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787312.112479:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787312.112482:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9870f577b370) has no exports 00000020:00000080:3.0:1787787312.112485:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8a1d 00000020:00000080:3.0:1787787312.112488:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870f5601000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787787312.113749:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787787312.113763:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38b9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787787312.113770:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc38d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787787312.113778:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc388000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787787312.113785:0:38:0:(genops.c:885:class_export_put()) final put ffff986fc38be800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787312.113788:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38be800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787787312.113793:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787787312.113878:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a00000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787787312.113884:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc38b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787787312.113893:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc38e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787787312.113898:0:38:0:(genops.c:885:class_export_put()) final put ffff9870fc38d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787312.113901:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc38d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787787312.113906:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787787312.113948:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc28f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787787312.113952:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5601000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787787312.121296:0:15160:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1787787312.121305:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787787312.121310:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787787312.121319:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787312.121580:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787312.121595:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787312.121629:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787312.121633:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787312.121654:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df55e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787787312.121659:0:15160:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df55e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787787312.121668:0:15160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787787312.122026:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f5601800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787787312.122036:0:38:0:(genops.c:885:class_export_put()) final put ffff9870fc07e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787312.122039:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc07e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787787312.122046:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787312.122223:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8872 00000020:00000080:3.0:1787787312.122231:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f6000/lustre-MDD0000_UUID 00000020:01000000:3.0:1787787312.122243:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787787312.122247:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787312.122253:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787312.122257:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9870d22f0000) has no exports 00000020:00000080:1.0:1787787312.122258:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787787312.122279:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787312.122284:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787787312.122286:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f0000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787787312.122288:0:15160:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787787312.122293:0:15160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787787312.122321:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8879 00000020:00000080:3.0:1787787312.122338:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f3000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787787312.122357:0:15160:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c3240800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787787312.122569:0:15160:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c3240800 3 00000020:01000004:3.0:1787787312.122574:0:15160:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870c3240800 from lustre-MDT0000 00000020:00000080:3.0:1787787312.122592:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787312.122596:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787787312.122599:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f2000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787787312.122601:0:15160:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787787312.122607:0:15160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787787312.122635:0:15160:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1787787312.122638:0:15160:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787787312.122641:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787787312.122643:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787312.122645:0:15160:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787787312.122652:0:15160:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9870c7f37000 697ab143-19fe-4215-afba-68a282afbaf6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787787312.122657:0:15160:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9870d1558000) has exports, disconnecting them 00000020:00080000:3.0:1787787312.122661:0:15160:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9870c7f37000), last request at 1787787047 00000020:00000080:3.0:1787787312.122681:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8810 00000020:00010000:3.0:1787787312.122685:0:15160:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9870c7f37000: total 2 00000100:00080000:3.0:1787787312.122689:0:15160:0:(import.c:65:import_set_state_nolock()) ffff9870c7f35000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787787312.122735:0:15160:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870c7f37000): rc 0 00000020:00080000:3.0:1787787312.122739:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9870d1558000) has no exports 00000100:00100000:3.0:1787787312.122799:0:6520:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9870c2c0d200:6520] 1 exiting: rc = 0 00000020:00010000:0.0:1787787312.122979:0:6516:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9870c7f37000: total 2 00010000:00010000:0.0:1787787312.123017:0:6516:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9870c7f37000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787787312.123049:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454e200/0x11620bc3f30a8d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d49 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123064:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6800/0x11620bc3f30a8d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d57 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123075:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15200/0x11620bc3f30a8913 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a890c expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123087:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1390c00/0x11620bc3f30a8d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d65 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123099:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14c00/0x11620bc3f30a8921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a891a expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123111:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3c00/0x11620bc3f30a8fb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8fb1 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123120:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4400/0x11620bc3f30a8fc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8fbf expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123129:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391200/0x11620bc3f30a8d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d8f expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123222:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5400/0x11620bc3f30a8fd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8fcd expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123247:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a8c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8c31 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123259:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f454fa00/0x11620bc3f30a8d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d3b expref: 4 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123268:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc2a8ba00/0x11620bc3f30a8d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d1f expref: 3 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123277:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c1391c00/0x11620bc3f30a8d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a8d2d expref: 2 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787312.123286:0:6516:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9870c7f37000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787787312.123297:0:6516:0:(genops.c:885:class_export_put()) final put ffff9870c7f37000/697ab143-19fe-4215-afba-68a282afbaf6 00010000:00010000:0.0:1787787312.123629:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787787312.123631:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787787312.123632:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787312.123636:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787787312.123643:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c7f37000/697ab143-19fe-4215-afba-68a282afbaf6 for MGS 00000020:00000080:1.0:1787787312.123678:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c7f35000 for MGS 00000100:00100000:0.0:1787787312.123686:0:6519:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9870c5451200:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1787787312.123786:0:6522:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9870ed905000:6522] 2 exiting: rc = 0 00000100:00100000:0.0:1787787312.123848:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123860:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123868:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123873:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123878:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123884:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123890:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123896:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123901:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123906:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123911:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123917:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123923:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123936:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123941:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123947:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123953:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123958:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123962:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123967:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123972:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123977:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123982:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123987:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123992:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.123998:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124003:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124008:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124013:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124018:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124023:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124028:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124033:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124037:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124042:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124046:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124051:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124056:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124060:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124065:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124071:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124076:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124080:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124085:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124089:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124093:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124098:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124102:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124111:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124116:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124121:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124126:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124131:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124153:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124158:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124163:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124168:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124173:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124178:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124183:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124187:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124192:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124197:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787312.124202:0:15160:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787787312.125831:0:15160:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc3916300 - data ffff986fc2037d80/ffff986fc3b7a800 00000020:01000000:1.0:1787787312.125936:0:15160:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870d84d5ea0 - data ffff9870c86e06c0/ffff9870d22c4400 00000020:00000080:1.0:1787787312.126415:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a87fb 00000020:00000080:1.0:1787787312.126423:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870ed89c000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787787312.126753:0:15160:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c3240800 from MGS, refs=2 00000020:01000004:1.0:1787787312.126758:0:15160:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c3240800 2 00000020:01000004:1.0:1787787312.126761:0:15160:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870c3240800 from MGS 00000020:00000080:1.0:1787787312.126782:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787312.126788:0:15160:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787787312.126790:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870c3595000/MGS 00000020:00000080:1.0:1787787312.126793:0:15160:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3595000/MGS for MGS 00000020:01000000:1.0:1787787312.126810:0:15160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787787312.126866:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787787312.126869:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787312.126874:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787787312.126880:0:15160:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9870df5f7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787312.126885:0:15160:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff987101db19b8) has exports, disconnecting them 00000020:00080000:1.0:1787787312.126889:0:15160:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9870df5f7000), last request at 1787787048 00000020:00000080:1.0:1787787312.126894:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a88c6 00000020:00080000:1.0:1787787312.126903:0:15160:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870df5f7000): rc 0 00000020:00000080:1.0:1787787312.126907:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870df5f7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787787312.126929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ed89c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787312.127196:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787787312.130962:0:15160:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787787312.130971:0:15160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787787312.130976:0:15160:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787787312.131004:0:15160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787787312.131231:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787312.131238:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787787312.131246:0:15160:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c3240800 1 00000020:00000080:0.0:1787787312.131253:0:15160:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a87ed 00000020:00000080:0.0:1787787312.131262:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870d4e4e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787787312.131267:0:15160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787787312.131272:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787312.131276:0:15160:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787787312.131279:0:15160:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9870d155b370) has no exports 00000020:00000080:3.0:1787787312.134204:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870df5f5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787787312.134222:0:8:0:(genops.c:885:class_export_put()) final put ffff9870df5f2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787787312.134226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df5f2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787787312.134234:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787787312.134313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d4e4e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787787312.187234:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787312.187249:0:15160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787787312.187255:0:15160:0:(genops.c:885:class_export_put()) final put ffff9870c3e99800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787787312.187259:0:15160:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3e99800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787787312.187266:0:15160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787787312.187405:0:15160:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870c3243000 00000020:02000400:2.0:1787787312.187466:0:15160:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787787312.937700:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787313.973976:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787314.537871:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503728640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787314.537980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787314.538245:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728640 00000100:00100000:3.0:1787787314.538257:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728640 00000100:00100000:3.0:1787787314.538352:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787314.538362:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503728640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787314.538403:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787787314.538488:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787314.539111:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503728640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 747us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787314.539123:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787787314.539356:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503728640:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787787314.985633:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787787315.336524:0:15363:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787787315.356345:0:15363:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787787315.356421:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.356437:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.356445:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.356453:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.356472:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787787315.356477:0:15363:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787787315.356503:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787787315.356508:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787787315.356512:0:15363:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787787315.356518:0:15363:0:(import.c:65:import_set_state_nolock()) ffff9870fc07f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787787315.356522:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787787315.356524:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787787315.356527:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787787315.357176:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787315.357187:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787315.357197:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454fc00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787315.357201:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787315.357220:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787315.357229:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787315.357234:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787315.357237:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787787315.357240:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787787315.357289:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787315.357296:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787315.357334:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787315.357342:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454fc00/0x11620bc3f30a8d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d5e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787315.357354:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787315.357356:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787315.357358:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787315.357435:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787315.357453:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503728768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787315.357520:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787315.357734:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728768 00000100:00100000:3.0:1787787315.357742:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728768 00000100:00100000:3.0:1787787315.357836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787787315.357844:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c92da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3656:x1874630503728768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787787315.357850:0:6512:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787315 with bad export cookie 1252576582586501136 00010000:00010000:0.0:1787787315.358297:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358310:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358316:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358336:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358353:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787315.358360:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358366:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358372:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358378:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358390:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787315.358414:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787315.358418:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358424:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454fe00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787315.358428:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358446:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787315.358453:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787315.358466:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787315.358469:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1787787315.358486:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358491:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787315.358507:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358514:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454fe00/0x11620bc3f30a8d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8d6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358525:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787315.358528:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358533:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6a00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787315.358536:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358541:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787315.358547:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787315.358553:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787315.358555:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787787315.358557:0:6516:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787787315.358575:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358580:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787315.358592:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358598:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c6a00/0x11620bc3f30a8c31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8c38 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787315.358611:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787315.358612:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787315.358614:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787315.358625:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503729024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787315.358678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787315.358728:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787315.358738:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787315.358747:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503728896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787315.360235:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360253:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360273:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360280:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360319:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787315.360327:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360334:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360340:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360347:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360359:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787787315.360364:0:15363:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1787787315.360370:0:15363:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1787787315.360419:0:15363:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787787315.360423:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1787787315.360427:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787315.360432:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787787315.360439:0:15363:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff986fc2a02000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787315.360444:0:15363:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9870f3637000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787315.360449:0:15363:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9870f45899b8) has exports, disconnecting them 00000020:00080000:1.0:1787787315.360454:0:15363:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff986fc2a02000), last request at 1787787311 00000020:00000080:1.0:1787787315.360461:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8bf9 00000100:00080000:1.0:1787787315.360478:0:15363:0:(import.c:65:import_set_state_nolock()) ffff9870fc38f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787787315.360522:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787315.360528:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360540:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787315.360543:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360551:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787315.360558:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787315.360563:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787787315.360566:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787787315.360568:0:10345:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787787315.360597:0:10345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360603:0:10345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787315.360618:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360624:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5e00/0x11620bc3f30a8fcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8fd4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360636:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787315.360640:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360655:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787315.360658:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360671:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787315.360677:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787315.360683:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787787315.360685:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787787315.360687:0:10345:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787787315.360699:0:10345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360706:0:10345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787315.360718:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360724:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a891a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a8921 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787315.360738:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787315.360740:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787315.360741:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787315.360754:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503729152:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787787315.360971:0:15363:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc2a02000): rc 0 00000020:00000080:1.0:1787787315.360975:0:15363:0:(genops.c:885:class_export_put()) final put ffff986fc2a02000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787787315.360988:0:15363:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9870f3637000), last request at 1787787311 00000020:00000080:1.0:1787787315.360992:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8ad3 00000100:00080000:1.0:1787787315.361000:0:15363:0:(import.c:65:import_set_state_nolock()) ffff9870f3607800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787787315.361013:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787787315.361028:0:15363:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f3637000): rc 0 00000020:00000080:1.0:1787787315.361031:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f3637000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787787315.361040:0:15363:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa6224192fae0 00000100:00080000:1.0:1787787315.361060:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787315.361068:0:15363:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff986fc43f12c0 x1874630503725312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787787317 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787315.361078:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1787787315.362257:0:6514:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787787315.362284:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787787315.362308:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787315.362334:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503729280:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787787315.362378:0:15363:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787787315.362384:0:15363:0:(import.c:65:import_set_state_nolock()) ffff9870f5607000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1787787315.363008:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787787315.363021:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503729024 00000100:00100000:2.0:1787787315.363029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503729024 00000100:00100000:2.0:1787787315.363058:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787787315.363063:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503728896 00000100:00100000:2.0:1787787315.363065:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503728896 00000100:00100000:2.0:1787787315.363184:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503725312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787787315.363273:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787315.363353:0:15364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787315.363606:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787315.363663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787315.363691:0:6514:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787787315.363714:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787787315.363722:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1787787315.363818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503729280 00000100:00100000:0.0:1787787315.363822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503729280 00000100:00100000:0.0:1787787315.363838:0:6514:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787787315.363845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503729152 00000100:00100000:0.0:1787787315.363847:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503729152 00000100:00100000:2.0:1787787315.363925:0:15364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3653:x1874630503729024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787787315.363935:0:15364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787315 with bad export cookie 1252576582586501136 00000100:00100000:2.0:1787787315.364044:0:15364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3653:x1874630503729024:12345-0@lo:103:ldlm_bl.0 Request processed in 682us (5364us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787315.364052:0:15364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787315.364073:0:15364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787315.364077:0:15364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3655:x1874630503728896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787787315.364082:0:15364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787315 with bad export cookie 1252576582586501136 00000100:00100000:2.0:1787787315.364110:0:15364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3655:x1874630503728896:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (1804us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787315.364116:0:15364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787315.364127:0:15364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787315.364130:0:15364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3655:x1874630503729280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787787315.364135:0:15364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787315 with bad export cookie 1252576582586501136 00000100:00100000:2.0:1787787315.364194:0:15364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3655:x1874630503729280:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (588us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787315.364200:0:15364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787315.364214:0:15364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787315.364218:0:15364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874630503729152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787787315.364222:0:15364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787315 with bad export cookie 1252576582586501136 00000100:00100000:2.0:1787787315.364254:0:15364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874630503729152:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (590us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787315.364272:0:15364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787787315.364352:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787787315.364356:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787787315.364360:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:2.0:1787787315.365274:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a02000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787787315.365327:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3637000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787787315.365351:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc38f800 for lustre-MDT0001 00000020:00000080:2.0:1787787315.365355:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f3607800 for lustre-MDT0001 00010000:00010000:2.0:1787787315.365367:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787315.366290:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787787315.369246:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787787315.387885:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.131@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787787315.387907:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787787315.387917:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc41703c0 x1874630503728768/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787331 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787315.387936:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4898f00 x1874630503729024/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787331 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787315.387959:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc489bc00 x1874630503728896/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787331 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787315.387968:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9870fc3f4780 x1874630503729152/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787331 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787315.387984:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9870fc3f7c00 x1874630503729280/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787331 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787787315.387998:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787787315.388001:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787787315.388003:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787787315.388007:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787315.388012:0:3654:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 191 00000100:00080000:0.0:1787787315.388021:0:3654:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff9870ed89f800 using connection 192.168.204.131@tcp/0@lo 00000100:00080000:1.0:1787787315.388023:0:3653:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9870ed89f800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1787787315.388049:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:697ab143-19fe-4215-afba-68a282afbaf6:3653:1874630503729024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787315.388059:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:697ab143-19fe-4215-afba-68a282afbaf6:3656:1874630503728768:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787787315.388068:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9870ed89f800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1787787315.388117:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503728896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787315.388156:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:697ab143-19fe-4215-afba-68a282afbaf6:3655:1874630503729280:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787787315.388292:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787787315.388295:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1787787315.388444:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787787315.388515:0:15363:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787787315.388538:0:15363:0:(import.c:65:import_set_state_nolock()) ffff9870df55d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787787315.388554:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787787315.388556:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787787315.388564:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787787315.388623:0:15363:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787787315.388631:0:15363:0:(import.c:65:import_set_state_nolock()) ffff9870ff9be000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787787315.388654:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9870f45899b8) has no exports 00000100:00100000:0.0:1787787315.388935:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503729408:0@lo:9:umount.0 00000100:00100000:0.0:1787787315.389008:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787315.389051:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503729536:0@lo:9:umount.0 00000100:00100000:0.0:1787787315.389073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787315.389408:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc42830c0 x1874630503729664/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787315.389437:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503729664:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787787315.389470:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630503729664 offset 0 length 520: 4 00000100:00100000:0.0:1787787315.389515:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:697ab143-19fe-4215-afba-68a282afbaf6:3654:1874630503729152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787315.390020:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503729408 00000100:00100000:2.0:1787787315.390029:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503729408 00000100:00100000:2.0:1787787315.390084:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503729536 00000100:00100000:2.0:1787787315.390088:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503729536 00000100:00100000:2.0:1787787315.390121:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787787315.390131:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874630503729408:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787787315.390175:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b2e 00000100:00080000:2.0:1787787315.390186:0:8441:0:(import.c:65:import_set_state_nolock()) ffff986fc2a01800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787315.390236:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787787315.390599:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787315.390610:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1874630503729536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787787315.390631:0:13816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8c62 00000100:00080000:1.0:1787787315.390637:0:13816:0:(import.c:65:import_set_state_nolock()) ffff9870f5ba6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787315.390667:0:13816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1787787315.391024:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787315.391061:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9be000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787787315.391074:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787787315.391076:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787315.391080:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503729536:0@lo:9:umount.0 00000100:00100000:1.0:1787787315.391298:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3652:x1874630503729536:12345-0@lo:9:umount.0 Request processed in 690us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787315.391305:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1787787315.391333:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787315.392059:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3652:x1874630503729408:12345-0@lo:9:umount.0 Request processed in 1927us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787315.392067:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1787787315.392164:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787315.392562:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870df55d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787787315.392616:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787787315.392692:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787315.392697:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503729408:0@lo:9:umount.0 00000400:00000100:2.0:1787787315.398853:0:6512:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874630503728768 offset 224 length 224: 4 00000100:00100000:2.0:1787787315.398881:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c92da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3656:x1874630503728768:12345-0@lo:103:ldlm_bl.0 Request processed in 41036us (41359us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787315.398894:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:0.0:1787787315.404558:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9870f45899b8) has no exports 00000020:01000000:1.0:1787787315.442910:0:15363:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc28e5240 - data ffff986fc208a438/ffff986fc3b68800 00000020:01000000:1.0:1787787315.443072:0:15363:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870f575bc60 - data ffff9870f0649288/ffff9870f5760400 00000001:00000004:0.0:1787787315.456341:0:15363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1787787315.500320:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787315.500332:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787787315.500352:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787787315.507865:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787787315.507875:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1787787315.508223:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787315.508227:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787787315.510111:0:9024:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787787315.510118:0:9024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787787315.510131:0:9024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787787315.510729:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787787315.510734:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787787315.510752:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787315.510755:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787787315.510990:0:9840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787787315.510994:0:9840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787787315.511002:0:9840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787787315.515649:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a893d 00000020:00000080:3.0:1787787315.515663:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f4594000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787315.516307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4594000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787787315.517691:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8952 00000020:00000080:3.0:1787787315.517702:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f4597000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787787315.517720:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787787315.517725:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787315.517733:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787315.517738:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9870f4588000) has no exports 00000004:01000000:3.0:1787787315.517910:0:15363:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787787315.517918:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8c5b 00000020:00000080:3.0:1787787315.517923:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f5ba7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787787315.517927:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787787315.517931:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787315.517937:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787315.517939:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9870f55f3370) has no exports 00000020:00000080:3.0:1787787315.517944:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8c54 00000020:00000080:3.0:1787787315.517947:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870ff9ba000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787787315.518941:0:15363:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787787315.518948:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787787315.518952:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787787315.518959:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787315.518962:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787315.518995:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787315.519016:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787787315.519025:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b19 00000020:00000080:3.0:1787787315.519030:0:15363:0:(genops.c:885:class_export_put()) final put ffff986fc2a15800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787787315.519035:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787787315.519038:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787315.519042:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787315.519045:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9870fc36b370) has no exports 00000020:00000080:3.0:1787787315.519050:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b12 00000020:00000080:3.0:1787787315.519053:0:15363:0:(genops.c:885:class_export_put()) final put ffff986fc2760800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787315.519338:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4597000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787787315.519349:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5ba7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787787315.519353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ff9ba000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787787315.519359:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870ff9be000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787787315.519365:0:8:0:(genops.c:885:class_export_put()) final put ffff9870f5ba6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787315.519368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5ba6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787787315.519372:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787787315.519449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a15800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787787315.519454:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2760800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787787315.521748:0:15363:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787787315.522396:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787787315.522403:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1787787315.522412:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787315.522414:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787315.522515:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787315.522544:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787787315.522561:0:15363:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787787315.522569:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8975 00000020:00000080:3.0:1787787315.522578:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f576a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787315.523045:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870df55d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787787315.523054:0:8:0:(genops.c:885:class_export_put()) final put ffff986fc2762000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787315.523057:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2762000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787787315.523065:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787787315.523416:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787787315.523422:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787315.523429:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787315.523433:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9870f55f19b8) has no exports 00000020:00000080:3.0:1787787315.523440:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a896e 00000020:00000080:3.0:1787787315.523445:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870df55c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787315.523622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f576a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787787315.523629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df55c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787787315.526059:0:15363:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787787315.526069:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787787315.526073:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787787315.526081:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787787315.526163:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787315.526173:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787787315.526199:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787315.526203:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787787315.526209:0:15363:0:(genops.c:885:class_export_put()) final put ffff987101e73800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787787315.526214:0:15363:0:(genops.c:844:class_export_destroy()) destroying export ffff987101e73800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787787315.526222:0:15363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787787315.526422:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f5607000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787787315.526439:0:8:0:(genops.c:885:class_export_put()) final put ffff9870df559800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787315.526443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870df559800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787787315.526451:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787787315.526473:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8959 00000020:00000080:0.0:1787787315.526482:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f4590800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787787315.526494:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787787315.526499:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787315.526504:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787787315.526507:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9870f458cd28) has no exports 00000020:00000080:0.0:1787787315.526544:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787315.526548:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787787315.526553:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8960 00000020:00000080:0.0:1787787315.526558:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f4596800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787787315.526567:0:15363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870d2373000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787787315.526570:0:15363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870d2373000 2 00000020:01000004:0.0:1787787315.526574:0:15363:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870d2373000 from lustre-MDT0001 00000020:00000080:1.0:1787787315.526576:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4590800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787787315.526582:0:8:0:(genops.c:885:class_export_put()) final put ffff9870f4595800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787787315.526584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4595800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787787315.526588:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1787787315.526592:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787315.526596:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787787315.526598:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870f4590000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787787315.526600:0:15363:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4590000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787787315.526608:0:15363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787787315.526652:0:15363:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787787315.526656:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787787315.526659:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787315.526662:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787315.526669:0:15363:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9870fc07d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787315.526674:0:15363:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9870f577cd28) has exports, disconnecting them 00000020:00080000:0.0:1787787315.526680:0:15363:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9870fc07d000), last request at 1787787066 00000020:00000080:0.0:1787787315.526684:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a89b4 00000020:00080000:0.0:1787787315.526695:0:15363:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870fc07d000): rc 0 00000020:00000080:0.0:1787787315.526699:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870fc07d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787787315.526860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f4596800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787787315.526866:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc07d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787787315.539235:0:15363:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787787315.539244:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787315.539249:0:15363:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787787315.539270:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787787315.539304:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc07f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787787315.539491:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787315.539499:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787787315.539504:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870fc07d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787787315.539508:0:15363:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc07d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787787315.539517:0:15363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787787315.539596:0:15363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870d2373000 1 00000020:00000080:1.0:1787787315.539601:0:15363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a88f0 00000020:00000080:1.0:1787787315.539609:0:15363:0:(genops.c:885:class_export_put()) final put ffff987101cdb800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787787315.539618:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787787315.539625:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff987101cdb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787787315.539635:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787315.539640:0:15363:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787787315.539643:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff987101db4d28) has no exports 00000020:00000080:0.0:1787787315.594382:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787315.594396:0:15363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787787315.594401:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870d2376800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787787315.594414:0:15363:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d2376800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787787315.594425:0:15363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787787315.594530:0:15363:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870d2372000 00000020:01000000:0.0:1787787315.594547:0:15363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787787315.594550:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787315.594553:0:15363:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787787315.594557:0:15363:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9870d22f19b8) has no exports 00000100:00100000:0.0:1787787315.594719:0:6528:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9870d1c0ee00:6528] 1 exiting: rc = 0 00000100:00100000:3.0:1787787315.594720:0:13672:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff986fc3ac6200:13672] 4 exiting: rc = 0 00000100:00100000:2.0:1787787315.594856:0:7753:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff987101eee400:7753] 3 exiting: rc = 0 00000100:00100000:1.0:1787787315.594862:0:6529:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9870d9485a00:6529] 2 exiting: rc = 0 00000100:00100000:0.0:1787787315.594958:0:13825:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff986fc3ab7400:13825] 5 exiting: rc = 0 00000100:00100000:0.0:1787787315.595212:0:6527:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9870d1a90600:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1787787315.595290:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595298:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595305:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595310:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595316:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595321:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595327:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595332:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595337:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595342:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595348:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595354:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595359:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595363:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595369:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595375:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595380:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595385:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595389:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595394:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595399:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595404:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595409:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595415:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595430:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595436:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595442:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595448:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595453:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595459:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595465:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595470:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595475:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595481:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595488:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595493:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595499:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595504:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595509:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595514:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595519:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595524:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595529:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595535:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595541:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595546:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595551:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595556:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595561:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595566:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595570:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595575:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595581:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595586:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595592:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595597:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595602:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595608:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595614:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595628:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595634:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595639:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595645:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.595650:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598573:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9870d4d79e00:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1787787315.598729:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9870c2c4a600:6530] 0 exiting: rc = 1 00000100:00100000:0.0:1787787315.598827:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598835:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598841:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598846:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598851:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598857:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598864:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598870:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598876:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598881:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598887:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598892:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598898:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598903:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598909:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598914:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598919:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598924:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598929:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598934:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598939:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598943:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598948:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598953:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598958:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598964:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598969:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598974:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598979:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.598995:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599000:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599005:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599010:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599015:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599019:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599024:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599029:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599033:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599039:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599043:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599048:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599053:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599058:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599063:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599068:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599073:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599078:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599083:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599088:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599093:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599097:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599102:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599107:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599112:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599116:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599121:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599126:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599131:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599246:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599252:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599267:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599273:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599278:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.599283:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787315.600369:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9870d9484200:6532] 0 exiting: rc = 1 00000100:00100000:2.0:1787787315.600519:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9870d1c0e200:6533] 1 exiting: rc = 0 00000100:00100000:0.0:1787787315.600829:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600839:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600846:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600865:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600872:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600878:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600884:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600890:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600895:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600901:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600907:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600914:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600920:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600926:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600931:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600950:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600957:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600963:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600969:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600976:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600982:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600988:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.600995:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601001:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601007:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601013:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601019:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601053:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601061:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601067:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601073:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601080:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601087:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601093:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601098:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601116:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601124:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.601131:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602006:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602037:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602044:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602050:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602055:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602061:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602074:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602080:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602086:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602092:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602097:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602103:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602111:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602132:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602195:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602201:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602207:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602214:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602220:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602228:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602233:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602239:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602246:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602252:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602268:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.602275:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787315.610623:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9870d84cf800:6534] 0 exiting: rc = 1 00000100:00100000:0.0:1787787315.610684:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9870d4d79600:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1787787315.610870:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610891:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610899:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610908:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610915:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610923:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610929:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610936:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610942:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610949:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610955:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610961:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610968:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610974:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610980:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610986:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610992:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.610998:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611004:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611011:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611017:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611023:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611032:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611042:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611053:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611059:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611063:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611067:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611071:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611076:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611080:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611085:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611090:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611095:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611108:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611295:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611373:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611384:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611394:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611399:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611408:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611415:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611420:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611426:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611433:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611441:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611447:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611453:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611458:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611464:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611482:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611487:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611492:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611497:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611531:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611541:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611548:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611555:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611562:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611569:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611576:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611583:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611588:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.611596:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.613464:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9870c82e4800:6537] 1 exiting: rc = 0 00000100:00100000:3.0:1787787315.613699:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9870c82e4c00:6536] 0 exiting: rc = 1 00000100:00100000:0.0:1787787315.613800:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613807:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613813:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613817:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613822:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613839:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613845:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613850:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613855:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613861:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613866:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613871:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613877:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613892:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613898:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613904:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613909:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613915:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613920:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613925:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613931:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613936:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613942:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613948:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613953:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613958:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613964:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613969:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613974:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613980:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613985:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613990:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.613995:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614001:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614006:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614012:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614017:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614022:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614028:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614034:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614046:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614051:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614057:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614062:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614066:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614071:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614076:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614081:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614086:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614091:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614096:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614101:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614106:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614111:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614116:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614120:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614125:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614129:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614133:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614157:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614162:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614167:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614172:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.614177:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.614859:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9870c82e1600:6538] 0 exiting: rc = 1 00000100:00100000:3.0:1787787315.614987:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9870d2347800:6539] 1 exiting: rc = 0 00000100:00100000:0.0:1787787315.616750:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616762:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616769:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616776:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616783:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616791:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616801:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616810:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616818:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616823:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616829:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616851:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616857:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616861:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616866:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616872:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616877:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616882:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616888:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616893:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616898:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616903:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616908:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616913:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616918:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616922:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616928:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616933:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616938:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616945:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616950:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616954:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616958:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616962:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616968:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616972:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616978:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616982:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616987:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616992:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.616998:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617004:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617009:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617014:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617019:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617024:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617038:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617043:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617048:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617052:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617057:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617062:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617067:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617072:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617077:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617081:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617086:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617091:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617096:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617101:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617106:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617111:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617116:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.617122:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787315.617867:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9870c82e8a00:6541] 1 exiting: rc = 0 00000100:00100000:3.0:1787787315.618111:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9870c82e8e00:6540] 0 exiting: rc = 1 00000100:00100000:3.0:1787787315.618376:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9870c82e8400:6542] 2 exiting: rc = 0 00000100:00100000:0.0:1787787315.619126:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619153:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619165:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619173:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619181:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619192:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619201:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619208:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619215:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619223:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619230:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619238:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619246:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619265:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619275:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619313:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619327:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619571:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619587:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619598:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619605:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619611:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619617:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619624:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619630:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619645:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619651:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619665:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619671:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619677:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619682:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619688:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619694:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619699:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619705:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619710:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619716:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619721:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619726:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619754:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619763:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619770:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619776:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619785:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619793:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619799:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619807:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619815:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619823:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619831:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619839:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619846:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619862:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619869:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619877:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619885:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619893:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619899:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619906:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619914:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619920:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619931:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619940:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787315.619966:0:15363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787787315.627944:0:15363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787315.627958:0:15363:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787787315.627964:0:15363:0:(genops.c:885:class_export_put()) final put ffff9870c554a800/MDS_uuid 00000020:00000080:0.0:1787787315.627969:0:15363:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c554a800/MDS_uuid for MDS 00000020:01000000:0.0:1787787315.627981:0:15363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787787315.628180:0:15363:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787787316.014349:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787317.033417:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787317.098312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787317.098324:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787317.098327:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787317.098331:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787787317.098335:0:8:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787317.098344:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1787787317.098352:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787787317.098360:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc2761000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787317.098398:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4282d00 x1874630503729792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787317.098454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787317.098458:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787787317.098467:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787317.098471:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1787787317.098473:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787787317.098477:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9870fc113800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787317.098491:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc42803c0 x1874630503730048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787317.098526:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787317.098553:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503729920:0@lo:400:kworker.0 00000400:00000100:0.0:1787787317.098603:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503729920 offset 0 length 224: 4 00000100:00100000:0.0:1787787317.098663:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787317.098674:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503730176:0@lo:400:kworker.0 00000400:00000100:0.0:1787787317.098693:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730176 offset 0 length 224: 4 00000100:00100000:1.0:1787787317.098861:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503729792:0@lo:38:kworker.0 00000400:00000100:1.0:1787787317.098885:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503729792 offset 0 length 520: 4 00000100:00100000:1.0:1787787317.098906:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503730048:0@lo:38:kworker.0 00000400:00000100:1.0:1787787317.098923:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730048 offset 0 length 520: 4 00010000:00010000:2.0:1787787318.057284:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787787318.651976:0:15565:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787787318.660394:0:15565:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787787318.660449:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787318.660466:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787318.660474:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787318.660481:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787318.660502:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787787318.660508:0:15565:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787787318.660532:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787318.660545:0:15565:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4282d00 x1874630503729792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787342 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787318.660558:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787787318.660564:0:15565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787787318.660570:0:15565:0:(import.c:65:import_set_state_nolock()) ffff986fc2761000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787787318.660575:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787318.660578:0:15565:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4282d00 x1874630503729792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787342 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787318.660585:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787787318.660588:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00000100:00100000:1.0:1787787318.660654:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503729792:0@lo:38:kworker.0 00000100:00080000:3.0:1787787318.661888:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787787318.661900:0:15565:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4280b40 x1874630503729920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787333 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787318.661990:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787787318.661996:0:15565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787787318.662019:0:15565:0:(import.c:65:import_set_state_nolock()) ffff9870df558000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787787318.662159:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503729920:0@lo:400:kworker.0 00000100:00100000:1.0:1787787318.662208:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503730304:0@lo:39:umount.0 00000400:00000100:1.0:1787787318.662268:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730304 offset 0 length 224: 4 00010000:00010000:2.0:1787787318.662540:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787318.662550:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787318.662560:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c1391600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787318.662564:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787318.662575:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787318.662582:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787318.662587:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787318.662591:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787787318.662600:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787787318.662615:0:6515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:2.0:1787787318.662620:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787318.662627:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c1391600/0x11620bc3f30a8d3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d42 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787318.662639:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787318.662640:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787318.662642:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787319.082016:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787320.105310:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787320.105311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787320.105320:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787320.105323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787320.105326:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787320.105529:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787320.105552:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503730432:0@lo:400:kworker.0 00000400:00000100:1.0:1787787320.105605:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730432 offset 0 length 224: 4 00000001:00100000:1.0:1787787320.684403:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787320.684413:0:9520:0:(genops.c:885:class_export_put()) final put ffff9870f5ba5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787787320.686576:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5ba5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787787320.686642:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f5ba6000 for lustre-OST0001 00000001:00100000:2.0:1787787320.686890:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787787320.686894:0:8436:0:(genops.c:885:class_export_put()) final put ffff986fc2a03000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787787320.686953:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a03000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787787320.686984:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc2a01800 for lustre-OST0000 00010000:00010000:2.0:1787787321.129329:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787322.153388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787322.153399:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787322.153402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787322.153417:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787322.153511:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787322.154443:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503730560:0@lo:400:kworker.0 00000400:00000100:3.0:1787787322.154502:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730560 offset 0 length 224: 4 00010000:00010000:1.0:1787787322.155260:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787323.177325:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787324.204512:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787325.226480:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787325.804282:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787315/real 1787787315] req@ffff986fc42830c0 x1874630503729664/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787787325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787325.804322:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc42830c0 x1874630503729664/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787787325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787325.804421:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787325.804435:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787787325.804440:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503729664:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1787787325.804456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787325.804465:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787787325.804469:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787325.804477:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1787787325.804484:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787787325.804492:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff9870ed89f800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787325.804529:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc41721c0 x1874630503730688/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787325.804692:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503730688:0@lo:250:kworker.0 00000400:00000100:2.0:1787787325.804762:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630503730688 offset 0 length 520: 4 00000100:00080000:3.0:1787787325.805456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787325.805463:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787325.805538:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787325.805569:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503730816:0@lo:400:kworker.0 00000400:00000100:2.0:1787787325.805602:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730816 offset 0 length 224: 4 00010000:00010000:2.0:1787787326.250579:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787327.275975:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787328.297458:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787328.873352:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787318/real 1787787318] req@ffff986fc4172580 x1874630503730304/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787328 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787328.873571:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4172580 x1874630503730304/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787328 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787787328.873612:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870df558000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787787328.873698:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503730304:0@lo:39:umount.0 00000100:00080000:3.0:1787787328.874320:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787787328.874326:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787787328.874331:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787787328.876492:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876526:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876534:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876541:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876633:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787328.876642:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876649:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876655:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.876661:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876794:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787328.876802:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876810:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8ae00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787328.876814:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876823:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787328.876830:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787328.876836:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787328.876839:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787787328.876850:0:10345:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:2.0:1787787328.876854:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876861:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc2a8ae00/0x11620bc3f30a8d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876878:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787328.876882:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876898:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc2a8b200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787328.876901:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876908:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787328.876914:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787328.876918:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787787328.876920:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787787328.876925:0:10345:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:2.0:1787787328.876928:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.876935:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787328.876936:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787328.876938:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787328.876983:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787787328.876989:0:15565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b200/0x11620bc3f30a8fbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8fc6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787328.877010:0:15565:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787787328.877019:0:15565:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787787328.877021:0:15565:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787787328.877051:0:15565:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787787328.877054:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787787328.877059:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787328.877064:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787787328.877068:0:15565:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9870f5778000) has no exports 00010000:00010000:2.0:1787787328.877208:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787787328.877391:0:15565:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9870f5778000) has no exports 00000020:01000000:3.0:1787787328.879873:0:15565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870f575bde0 - data ffff9870f0749a20/ffff986fc3b18c00 00000020:01000000:3.0:1787787328.880013:0:15565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc28e55a0 - data ffff9870f0694360/ffff9870f5bafc00 00100000:10000000:3.0:1787787328.891134:0:15565:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787787328.899962:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8a8d 00000020:00000080:0.0:1787787328.899981:0:15565:0:(genops.c:885:class_export_put()) final put ffff986fc10c6000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787787328.900079:0:15565:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc17b800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787787328.900085:0:15565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc17b800 2 00000020:01000004:0.0:1787787328.900089:0:15565:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870fc17b800 from lustre-OST0000 00000020:00000080:0.0:1787787328.900125:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787328.900171:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787787328.900175:0:15565:0:(genops.c:885:class_export_put()) final put ffff986fc10c7800/lustre-OST0000_UUID 00000020:00000080:0.0:1787787328.900193:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc10c7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787787328.900202:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787787328.900383:0:15565:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787787328.900390:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787787328.900459:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787328.900466:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787328.900475:0:15565:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff986fc2764800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787328.900483:0:15565:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9870f458b370) has exports, disconnecting them 00000020:00080000:0.0:1787787328.900489:0:15565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff986fc2764800), last request at 1787787084 00000020:00000080:0.0:1787787328.900494:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8ab7 00000020:00080000:0.0:1787787328.900506:0:15565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc2764800): rc 0 00000020:00000080:0.0:1787787328.900512:0:15565:0:(genops.c:885:class_export_put()) final put ffff986fc2764800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787787328.904178:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc10c6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787787328.905944:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2764800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787787328.905984:0:15565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787787328.905990:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787328.905996:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787787328.906013:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787328.906297:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc2761000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787787328.906482:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787328.906494:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787787328.906500:0:15565:0:(genops.c:885:class_export_put()) final put ffff986fc2762800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787787328.906504:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2762800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787787328.906510:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787787328.906592:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787787328.906597:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787328.906602:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787787328.906610:0:15565:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9870f3630800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787328.906618:0:15565:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff987101db0000) has exports, disconnecting them 00000020:00080000:1.0:1787787328.906623:0:15565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9870f3630800), last request at 1787787084 00000020:00000080:1.0:1787787328.906628:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8acc 00000020:00080000:1.0:1787787328.906645:0:15565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f3630800): rc 0 00000020:00000080:1.0:1787787328.906651:0:15565:0:(genops.c:885:class_export_put()) final put ffff9870f3630800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787787328.906881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3630800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787787328.916360:0:15565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787787328.916374:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787787328.916380:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787787328.916390:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787328.916556:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870df558000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787787328.916837:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787328.916871:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787787328.916878:0:15565:0:(genops.c:885:class_export_put()) final put ffff9870f3602800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787787328.916883:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3602800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787787328.916890:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787787328.916980:0:15565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc17b800 1 00000020:00000080:2.0:1787787328.916987:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8a55 00000020:00000080:2.0:1787787328.916997:0:15565:0:(genops.c:885:class_export_put()) final put ffff9870f576c800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787787328.917020:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787787328.917029:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f576c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787787328.917039:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787328.917045:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787787328.917121:0:15565:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9870f55f4d28) has no exports 00000020:00000080:0.0:1787787328.966986:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787328.967018:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787787328.967028:0:15565:0:(genops.c:885:class_export_put()) final put ffff9870fc17d000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787787328.967036:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc17d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787787328.967057:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787787328.967970:0:15565:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870fc17f000 00000020:02000400:0.0:1787787328.968057:0:15565:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787787329.329438:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787330.351943:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787330.921369:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787330.921381:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787330.921385:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787330.921388:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787330.921629:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787330.921653:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503730944:0@lo:400:kworker.0 00000400:00000100:2.0:1787787330.921705:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503730944 offset 0 length 224: 4 00010000:00010000:2.0:1787787331.369281:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787332.393376:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787332.426291:0:15767:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787787332.437394:0:15767:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787787332.437476:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787332.437491:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787332.437500:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787332.437511:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787332.437537:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787787332.437542:0:15767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787787332.437565:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787332.437575:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc42803c0 x1874630503730048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787342 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.437596:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787787332.437602:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787787332.437607:0:15767:0:(import.c:65:import_set_state_nolock()) ffff9870fc113800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787787332.437625:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787332.437630:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc42803c0 x1874630503730048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787342 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.437638:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787787332.437641:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:2.0:1787787332.437645:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787787332.437650:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503730048:0@lo:38:kworker.0 00010000:00010000:2.0:1787787332.437655:0:10345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787332.437668:0:10345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454e400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787332.437672:0:10345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787332.437679:0:10345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787332.437685:0:10345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787332.437697:0:10345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787332.437699:0:10345:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787787332.437701:0:10345:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787787332.437713:0:10345:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:2.0:1787787332.437716:0:10345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787332.437720:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454e400/0x11620bc3f30a8d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787332.437729:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787332.437731:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787332.437732:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787332.438599:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787787332.438610:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4280000 x1874630503730176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787333 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.438637:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4283c00 x1874630503730432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787336 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.438654:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9870fc3f6580 x1874630503730560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787338 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.438667:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc41712c0 x1874630503730816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.438677:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4280780 x1874630503730944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787346 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787332.438683:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787787332.438687:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787787332.438708:0:15767:0:(import.c:65:import_set_state_nolock()) ffff986fc38bc800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787787332.438827:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503731072:0@lo:39:umount.0 00000400:00000100:1.0:1787787332.438888:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503731072 offset 0 length 224: 4 00000100:00100000:2.0:1787787332.438909:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503730432:0@lo:400:kworker.0 00000100:00100000:2.0:1787787332.438987:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503730816:0@lo:400:kworker.0 00000100:00100000:0.0:1787787332.439407:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4280780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787787332.439419:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503730176:0@lo:400:kworker.0 00000100:00100000:0.0:1787787332.439450:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503730560:0@lo:400:kworker.0 00010000:00010000:2.0:1787787333.417322:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787334.441352:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787335.465495:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787336.044834:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787336.044845:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787787336.489285:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787337.513446:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787338.538116:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787339.561329:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787340.586417:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787340.649324:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787325/real 1787787325] req@ffff986fc41721c0 x1874630503730688/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787787340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787340.649370:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc41721c0 x1874630503730688/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787787340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787340.649394:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787340.649430:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787787340.649456:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503730688:0@lo:250:kworker.0 00000100:00080000:3.0:1787787340.649786:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 697ab143-19fe-4215-afba-68a282afbaf6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787340.649792:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787787340.649795:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787340.649800:0:38:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1787787340.649805:0:38:0:(import.c:589:import_select_connection()) MGC192.168.204.131@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787340.649819:0:38:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff9870ed89f800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787340.649848:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4170000 x1874630503731200/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787340.651619:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503731200:0@lo:250:kworker.0 00000400:00000100:2.0:1787787340.651675:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630503731200 offset 0 length 520: 4 00010000:00010000:2.0:1787787341.613068:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787342.633749:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787342.697363:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787332/real 1787787332] req@ffff986fc4172940 x1874630503731072/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787342.697420:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4172940 x1874630503731072/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787342.697444:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc38bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787787342.697469:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503731072:0@lo:39:umount.0 00000100:00080000:1.0:1787787342.698767:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787787342.698775:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787787342.698782:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787787342.700002:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700018:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700025:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700031:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700053:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787342.700060:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700066:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700072:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700089:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787342.700099:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700101:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700110:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f454f800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787342.700115:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787342.700165:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787787342.700171:0:15767:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787787342.700194:0:15767:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787787342.700199:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787787342.700203:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787342.700209:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787787342.700213:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9870fc36cd28) has no exports 00000020:00080000:1.0:1787787342.700235:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9870fc36cd28) has no exports 00010000:00010000:2.0:1787787342.700263:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787342.700272:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787342.700278:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787342.700281:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787787342.700301:0:6516:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787787342.700316:0:6516:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:2.0:1787787342.700320:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700328:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f454f800/0x11620bc3f30a8d2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700341:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787342.700345:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787342.700353:0:10345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787342.700353:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787342.700358:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700366:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787342.700373:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787342.700379:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787787342.700382:0:6516:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787787342.700384:0:6516:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787787342.700388:0:6516:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:2.0:1787787342.700391:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700398:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30a8fb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8fb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787342.700421:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787342.700423:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787342.700425:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787787342.702339:0:15767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc28e5840 - data ffff9870f055c438/ffff986fc3b69800 00000020:01000000:0.0:1787787342.702803:0:15767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc28e5480 - data ffff9870f04b1d80/ffff986fc39d7800 00100000:10000000:0.0:1787787342.718634:0:15767:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787787342.722615:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8bb3 00000020:00000080:0.0:1787787342.722668:0:15767:0:(genops.c:885:class_export_put()) final put ffff9870ff9bc800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787787342.722716:0:15767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870f5ba1800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787787342.722720:0:15767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870f5ba1800 2 00000020:01000004:0.0:1787787342.722723:0:15767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870f5ba1800 from lustre-OST0001 00000020:00000080:0.0:1787787342.722763:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787342.722774:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787787342.722777:0:15767:0:(genops.c:885:class_export_put()) final put ffff9870ff9bd800/lustre-OST0001_UUID 00000020:00000080:0.0:1787787342.722781:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ff9bd800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787787342.722800:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787787342.722917:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 697ab143-19fe-4215-afba-68a282afbaf6->MGS 00010000:00010000:0.0:1787787342.722933:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14000/0x11620bc3f30a890c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787342.722944:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14000/0x11620bc3f30a890c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787342.722951:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787787342.722953:0:15767:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787787342.722956:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787787342.722971:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:0.0:1787787342.722975:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14000/0x11620bc3f30a890c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8913 expref: -99 pid: 7457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787342.722990:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787342.722996:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787342.723008:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787342.723015:0:15767:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787787342.723017:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787787342.723047:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870ed89f800 00010000:00010000:0.0:1787787342.723050:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc2a8b000/0x11620bc3f30a8d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a8d96 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787787342.723091:0:15767:0:(import.c:65:import_set_state_nolock()) ffff9870ed89f800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787787342.723095:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787787342.723097:0:15767:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787787342.723098:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787787342.723102:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787787342.723112:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc4170000 x1874630503731200/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787787360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787787342.723132:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787787342.723134:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1787787342.723221:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:697ab143-19fe-4215-afba-68a282afbaf6:3652:1874630503731200:0@lo:250:kworker.0 10000000:01000000:0.0:1787787342.723317:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787787342.723323:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8809 00000020:00000080:0.0:1787787342.723328:0:15767:0:(genops.c:885:class_export_put()) final put ffff9870c554a000/697ab143-19fe-4215-afba-68a282afbaf6 00000020:00000080:2.0:1787787342.723370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ff9bc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787787342.723438:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.131@tcp (flags='') 00000020:00000080:0.0:1787787342.723444:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787342.723448:0:15767:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787787342.723452:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9870d15599b8) has no exports 10000000:01000000:3.0:1787787342.723533:0:6524:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787787342.723557:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.131@tcp: client import never connected 00000100:00080000:0.0:1787787342.723559:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787787342.723561:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787787342.723563:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787787342.723564:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787787342.723644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c554a000/697ab143-19fe-4215-afba-68a282afbaf6 for MGC192.168.204.131@tcp 00000020:00000080:0.0:1787787342.723747:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787342.723757:0:15767:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.131@tcp (uuid 697ab143-19fe-4215-afba-68a282afbaf6) 00000020:01000000:0.0:1787787342.723762:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787787342.723769:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787342.723773:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787342.723777:0:15767:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff986fc38ba800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787342.723850:0:15767:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9870f57799b8) has exports, disconnecting them 00000020:00080000:0.0:1787787342.723855:0:15767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff986fc38ba800), last request at 1787787105 00000020:00000080:0.0:1787787342.723859:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8bdd 00000020:00080000:0.0:1787787342.723868:0:15767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc38ba800): rc 0 00000020:00000080:0.0:1787787342.723871:0:15767:0:(genops.c:885:class_export_put()) final put ffff986fc38ba800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787787342.723895:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870ed89f800 for MGC192.168.204.131@tcp 00000020:00000080:2.0:1787787342.723901:0:8:0:(genops.c:885:class_export_put()) final put ffff9870ed89d000/697ab143-19fe-4215-afba-68a282afbaf6 00000020:00000080:2.0:1787787342.723903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ed89d000/697ab143-19fe-4215-afba-68a282afbaf6 for MGC192.168.204.131@tcp 00000020:01000000:2.0:1787787342.723907:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.131@tcp (697ab143-19fe-4215-afba-68a282afbaf6) 00000020:00000080:2.0:1787787342.725089:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38ba800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787787342.728933:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787787342.728978:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787787342.728982:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787787342.728989:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787342.729085:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc113800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787787342.729516:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787342.729525:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787787342.729535:0:15767:0:(genops.c:885:class_export_put()) final put ffff9870f5604800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787787342.729539:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5604800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787787342.729545:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787787342.729696:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787787342.729700:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787342.729706:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787342.729713:0:15767:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff986fc372d000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787342.729719:0:15767:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff986fc38c19b8) has exports, disconnecting them 00000020:00080000:0.0:1787787342.729724:0:15767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff986fc372d000), last request at 1787787105 00000020:00000080:0.0:1787787342.729728:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8bf2 00000020:00080000:0.0:1787787342.729753:0:15767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc372d000): rc 0 00000020:00000080:0.0:1787787342.729756:0:15767:0:(genops.c:885:class_export_put()) final put ffff986fc372d000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787787342.730409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc372d000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787787342.732669:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787787342.732682:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787787342.732687:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787787342.732693:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787342.732780:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc38bc800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787787342.737135:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787787342.737396:0:10345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787787342.737482:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787787342.738079:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9870c385fc00:6510] 0 exiting: rc = 1 00000100:00100000:1.0:1787787342.742276:0:6511:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9870c385f800:6511] 1 exiting: rc = 0 00000100:00100000:2.0:1787787342.746289:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.748403:0:6513:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9870c385fa00:6513] 1 exiting: rc = 0 00000100:00100000:0.0:1787787342.748403:0:6514:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9870ed8e9200:6514] 2 exiting: rc = 0 00000100:00100000:2.0:1787787342.748559:0:6512:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9870c385ec00:6512] 0 exiting: rc = 1 00000100:00100000:3.0:1787787342.748675:0:15364:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9870f36bd800:15364] 3 exiting: rc = 0 00000100:00100000:1.0:1787787342.751106:0:15365:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff986fc3a00a00:15365] 4 exiting: rc = 0 00000100:00100000:1.0:1787787342.751248:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751259:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751268:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751278:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751286:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751293:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751299:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751307:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751313:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751321:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751646:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751653:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751659:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751665:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751856:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751862:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751868:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751873:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751903:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751909:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751916:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751921:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751925:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751930:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751935:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751941:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.751945:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752081:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752086:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752091:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752096:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752100:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752105:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752110:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752115:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752119:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752124:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752128:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752132:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752136:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752159:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752163:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752167:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752172:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752177:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752189:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752194:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752199:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752203:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752208:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752212:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752216:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752221:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752225:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752230:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752235:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752238:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752242:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752246:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752251:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752255:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752259:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752264:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.752269:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787787342.761460:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787342.761484:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787787342.761490:0:15767:0:(genops.c:885:class_export_put()) final put ffff986fc38bf800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787787342.761494:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc38bf800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787787342.761503:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787787342.761565:0:15767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870f5ba1800 1 00000020:00000080:0.0:1787787342.761571:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a8b82 00000020:00000080:0.0:1787787342.761578:0:15767:0:(genops.c:885:class_export_put()) final put ffff986fc2a05800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787787342.761595:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787787342.761599:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787342.761605:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787787342.761608:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9870fc3699b8) has no exports 00000020:00000080:2.0:1787787342.763490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a05800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787787342.792231:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787342.792251:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787787342.792257:0:15767:0:(genops.c:885:class_export_put()) final put ffff9870f5ba3000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787787342.792262:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5ba3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787787342.792271:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787787342.793007:0:15767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870f5ba0000 00000020:01000000:3.0:1787787342.793044:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787787342.793049:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787342.793055:0:15767:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787787342.793059:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff987101db3370) has no exports 00000020:00000080:3.0:1787787342.793097:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787342.793105:0:15767:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787787342.793108:0:15767:0:(genops.c:885:class_export_put()) final put ffff9870f576d800/OSS_uuid 00000020:00000080:3.0:1787787342.793111:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f576d800/OSS_uuid for OSS 00000020:01000000:3.0:1787787342.793122:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787787342.793299:0:13816:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff986fc3779a00:13816] 4 exiting: rc = 0 00000100:00100000:3.0:1787787342.793312:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff987101d00800:8443] 1 exiting: rc = 0 00000100:00100000:1.0:1787787342.793438:0:9030:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9870f5767200:9030] 3 exiting: rc = 0 00000100:00100000:2.0:1787787342.793467:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9870fc0e8e00:8441] 0 exiting: rc = 1 00000100:00080000:0.0:1787787342.793824:0:6523:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787787342.793964:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff987101d01200:8444] 2 exiting: rc = 0 00000100:00100000:3.0:1787787342.794120:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794128:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794134:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794268:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794275:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794280:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794285:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794290:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794445:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794451:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794456:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794462:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794468:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794488:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794493:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794498:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794504:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794509:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794515:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794520:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794525:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794530:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794536:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794541:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794547:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794553:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794558:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794563:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794570:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794576:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794582:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794587:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794658:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794665:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794671:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794676:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794682:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794688:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794693:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794699:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794705:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794711:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794717:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794722:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794727:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794744:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794750:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794755:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794769:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794774:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794780:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794786:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794791:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794797:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794802:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794808:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794813:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794820:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794825:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794831:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794836:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794841:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794848:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.794859:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.796316:0:10154:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9870c7e90600:10154] 2 exiting: rc = 0 00000100:00100000:0.0:1787787342.796389:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9870fc048600:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1787787342.796411:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff987101ea8a00:8446] 1 exiting: rc = 0 00000100:00100000:3.0:1787787342.796508:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796522:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796534:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796539:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796546:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796552:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796558:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796563:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796568:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796574:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796579:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796588:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796594:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796603:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796610:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796614:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796619:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796624:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796634:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796646:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796651:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796661:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796672:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796678:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796684:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796690:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796696:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796701:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796706:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796711:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796720:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796725:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796742:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796751:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796756:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796762:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796767:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796773:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796778:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796785:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796790:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796795:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796800:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796805:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796809:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796814:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796819:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796824:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796829:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796834:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796838:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796843:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796847:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796851:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796879:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796886:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796892:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796899:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796904:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796909:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796914:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796918:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796925:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.796930:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.798483:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff987101eac200:8447] 0 exiting: rc = 1 00000100:00100000:2.0:1787787342.798606:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9870f5650800:8449] 2 exiting: rc = 0 00000100:00100000:0.0:1787787342.798624:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9870f5651c00:8448] 1 exiting: rc = 0 00000100:00100000:3.0:1787787342.798672:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798683:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798693:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798701:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798708:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798714:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798720:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798726:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798745:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798757:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798763:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798768:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798774:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798781:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798803:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798810:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798816:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798822:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798828:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798834:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798840:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798846:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798852:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798919:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798926:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798943:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798948:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798954:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798960:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798966:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798971:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798976:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798981:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798987:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798992:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.798998:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799003:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799008:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799026:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799032:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799038:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799043:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799048:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799052:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799057:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799064:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799070:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799077:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799083:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799088:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799094:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799100:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799105:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799110:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799115:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799121:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799127:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799133:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799397:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799405:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799423:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799428:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799434:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.799440:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787342.804691:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff987101e52e00:8450] 0 exiting: rc = 1 00000100:00100000:3.0:1787787342.805269:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff987101e53a00:8451] 1 exiting: rc = 0 00000100:00100000:2.0:1787787342.805691:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.805699:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.805705:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.805710:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.805716:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.805723:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.805728:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807267:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807275:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807282:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807288:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807294:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807300:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807306:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807311:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807316:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807321:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807327:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807508:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807513:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807519:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807526:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807531:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807537:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807543:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807549:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807555:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807561:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807567:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807574:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807579:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807584:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807589:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807595:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807619:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807624:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807630:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807637:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807642:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807647:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807653:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807658:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807664:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807669:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807676:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807682:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807688:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807694:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807699:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807705:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807712:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807718:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807724:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807740:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807747:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807752:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807757:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807763:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807769:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807775:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807781:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807787:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807792:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.807797:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787342.809744:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9870d153f400:8452] 0 exiting: rc = 1 00000100:00100000:1.0:1787787342.809749:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9870d153ee00:8453] 1 exiting: rc = 0 00000100:00100000:3.0:1787787342.809824:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809839:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809846:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809852:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809857:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809863:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809887:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809893:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809908:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809915:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809922:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809926:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809932:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809938:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809943:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809948:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809954:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809959:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809978:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809985:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.809994:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810004:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810013:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810023:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810030:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810037:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810043:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810050:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810056:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810066:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810108:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810116:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810122:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810129:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810152:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810160:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810169:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810177:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810183:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810188:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810194:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810202:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810227:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810236:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810244:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810254:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810261:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810271:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810282:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810290:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810297:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810315:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810324:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810331:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810354:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810364:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810372:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810380:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810386:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810392:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810402:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810412:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810420:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787342.810436:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787787342.818195:0:15767:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787787360.622688:0:16532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787787370.031900:0:17131:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787370.031911:0:17131:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787787370.031913:0:17131:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787787370.032033:0:17131:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870c5465000 00000020:01000004:3.0:1787787370.032049:0:17131:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787787370.032057:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787787370.032273:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9870f55f0000) 00000020:00000080:3.0:1787787370.032288:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787787370.106675:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787787370.110698:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787787370.113251:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.113558:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787787370.113933:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787787370.114249:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787787370.114566:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.115491:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.115809:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787787370.116037:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787787370.116460:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.117720:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787787370.118006:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.118530:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.119126:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787787370.120625:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1787787370.120948:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787787370.121397:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787787370.121653:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787787370.121891:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787787370.122218:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1787787370.122507:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1787787370.122735:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787787370.123113:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787787370.124732:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787787370.125233:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.129507:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787787370.132716:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.133532:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787787370.135339:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.137043:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.137829:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787787370.138791:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.140932:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787787370.142424:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787787370.150350:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787787370.150762:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787787370.150974:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787787370.151369:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787787370.152237:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787787370.153254:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787787370.153740:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787787370.155466:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.160985:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787787370.161475:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.161681:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787787370.162034:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787787370.166449:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787787370.166993:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787787370.167422:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787787370.167867:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787787370.168401:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787787370.169423:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1787787370.169906:0:17131:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787787370.171042:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787787370.171054:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787787370.171071:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9dc6 00000020:01000004:2.0:1787787370.171094:0:17131:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787787370.171099:0:17131:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787787370.171105:0:17131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870c5465000 from MGS 00000020:01000004:2.0:1787787370.171109:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787787370.171129:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff987101db0000) 00000020:00000080:2.0:1787787370.171168:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787787370.171248:0:17131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870c5465000 from MGS, refs=2 00080000:01000000:2.0:1787787370.171264:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787787370.171281:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9dd4 00000100:00100000:2.0:1787787370.171401:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787787370.171531:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787787370.171537:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787787370.173012:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787787370.173023:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787787370.174004:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787370.174475:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787787370.174482:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787787370.175005:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787787370.175012:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787787370.175617:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787787370.175629:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787787370.176587:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.176590:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.176592:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.176852:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.176855:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.176857:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787370.177704:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787787370.179942:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787787370.190191:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787787370.197467:0:17144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787787370.197532:0:17131:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787787370.197586:0:17131:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787787370.198179:0:17131:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787787370.198598:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787370.198763:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787787370.198770:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787787370.199536:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787787370.199544:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787787370.199905:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787787370.199911:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787787370.202059:0:17148:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787787370.202603:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787787370.202624:0:17131:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.131@tcp' 00000020:01000004:1.0:1787787370.202626:0:17131:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787787370.202655:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.131@tcp (typ=mgc) 00000020:00000080:1.0:1787787370.202668:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.131@tcp (ffff9870fc36b370) 00000020:00000080:1.0:1787787370.202682:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787787370.202756:0:17131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870c5802000@MGC192.168.204.131@tcp: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787370.202896:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.131@tcp-0 is initialized 00000040:01000000:1.0:1787787370.202902:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787787370.206466:0:17149:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787787370.206566:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.131@tcp (uuid 655a2ac3-6e05-4716-af47-ef6019dc5f23) 00000020:00000080:3.0:1787787370.206598:0:17131:0:(genops.c:1385:class_connect()) connect: client 655a2ac3-6e05-4716-af47-ef6019dc5f23, cookie 0x11620bc3f30a9de2 00000100:00080000:3.0:1787787370.206611:0:17131:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787370.206618:0:17131:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff9870c5802000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787370.206655:0:17131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4171e00 x1874630503731328/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787370.206700:0:17131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS 00000100:00100000:2.0:1787787370.208451:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:655a2ac3-6e05-4716-af47-ef6019dc5f23:3652:1874630503731328:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787787370.208531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.208617:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503731328 00000100:00100000:2.0:1787787370.208625:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503731328 00000100:00100000:2.0:1787787370.208666:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787370.208673:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3652:x1874630503731328:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787787370.208697:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 655a2ac3-6e05-4716-af47-ef6019dc5f23@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1787787370.208722:0:17145:0:(genops.c:1385:class_connect()) connect: client 655a2ac3-6e05-4716-af47-ef6019dc5f23, cookie 0x11620bc3f30a9de9 00000100:00080000:2.0:1787787370.208846:0:17145:0:(import.c:65:import_set_state_nolock()) ffff986fc2a16800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787370.208898:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+5:3652:x1874630503731328:12345-0@lo:250:mount.lustre.0 Request processed in 224us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.208906:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787370.208946:0:3652:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787787370.208955:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.131@tcp: connect to target with instance 0 00000100:00080000:2.0:1787787370.208962:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787787370.208967:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787787370.208970:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c5802000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787787370.208973:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787787370.208981:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787787370.208985:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:655a2ac3-6e05-4716-af47-ef6019dc5f23:3652:1874630503731328:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1787787370.209645:0:17131:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787787370.209664:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787787370.209680:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9870f55f4d28) 00000020:00000080:3.0:1787787370.209692:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787787370.229483:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787370.229692:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787787370.229699:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787787370.234851:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787787370.234870:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787787370.235809:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787787370.235817:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787787370.237965:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787370.238167:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787787370.238174:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787787370.238694:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787787370.238701:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787787370.279835:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787370.280505:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787787370.280512:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787787370.281902:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787787370.281918:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787787370.282771:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787370.282955:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787787370.282961:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787787370.283584:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787787370.283591:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787787370.284376:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787370.284532:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787787370.284537:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787787370.285658:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787787370.285670:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787787370.286846:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787370.287492:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787787370.287499:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787787370.288515:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787787370.288525:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787787370.308232:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787370.309021:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787787370.309028:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787787370.312489:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787787370.312506:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787787370.313895:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787787370.313918:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787787370.315797:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787787370.315825:0:17131:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787787370.315831:0:17131:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787787370.315952:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787787370.315983:0:17131:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.131@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787787370.315986:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787787370.315988:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787370.315989:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787370.315990:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787370.315991:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787370.315992:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787370.315994:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787370.315996:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787370.315997:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787370.315998:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787787370.316001:0:17131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787787370.316003:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787370.316004:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787370.316005:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787370.316006:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787370.316008:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787370.316009:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787370.316014:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787370.316015:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787370.316015:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787370.316016:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787787370.316043:0:17131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787787370.316062:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787787370.316166:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.316273:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503731456 00000100:00100000:3.0:1787787370.316280:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503731456 00000100:00100000:3.0:1787787370.316331:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787370.316341:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+5:17131:x1874630503731456:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787787370.316392:0:17147:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787787370.316395:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787787370.316398:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1787787370.316604:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38300 going to sleep for 11 seconds 10000000:01000000:2.0:1787787370.319263:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787787370.320611:0:17147:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787787370.324864:0:17169:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787787370.324874:0:17169:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787787370.324876:0:17169:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787787370.324879:0:17169:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787787370.325790:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787787370.326536:0:17147:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787787370.326549:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787787370.329278:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+5:17131:x1874630503731456:12345-0@lo:253:mount.lustre.0 Request processed in 12927us (13101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.329511:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787787370.329527:0:17131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787787370.329531:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787370.329533:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787370.329534:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787370.329536:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787370.329537:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787370.329539:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787370.329540:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787370.329541:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787370.329543:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787370.329544:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787787370.329563:0:17131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870c5465000 from lustre-MDT0000 10000000:01000000:2.0:1787787370.329596:0:17131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787787370.329599:0:17131:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787787370.329602:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9870fc36b370 10000000:01000000:2.0:1787787370.329606:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787370.329613:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9870fc36b370 from 1 10000000:01000000:2.0:1787787370.329616:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787787370.329651:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.329662:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.329691:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787370.329710:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787370.329747:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.329825:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.329928:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787370.329967:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503731584 00000100:00100000:0.0:1787787370.329972:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503731584 00000100:00100000:3.0:1787787370.330534:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787370.330547:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+5:17131:x1874630503731584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787370.330562:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787370.330582:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f2200/0x11620bc3f30a9dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9df7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.330609:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f2200/0x11620bc3f30a9dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9df7 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.330620:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f2200/0x11620bc3f30a9dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9df7 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.330628:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2200, rc 0) 00000100:00100000:3.0:1787787370.330673:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+6:17131:x1874630503731584:12345-0@lo:101:mount.lustre.0 Request processed in 130us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.330679:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787370.330777:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787370.330794:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.330803:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787370.330866:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787370.330893:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.330931:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787370.331108:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503731712 00000100:00100000:1.0:1787787370.331430:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503731712 00000100:00100000:1.0:1787787370.331470:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787370.331478:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+6:17131:x1874630503731712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787370.331559:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+6:17131:x1874630503731712:12345-0@lo:501:mount.lustre.0 Request processed in 82us (666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787370.331566:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787370.331638:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731712:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787787370.331670:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787787370.331690:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.331699:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787370.331707:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870c5465000 10000000:01000000:2.0:1787787370.331711:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787787370.331729:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9870c5465000 10000000:01000000:2.0:1787787370.331732:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787787370.331735:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9870c5465000 from 1 10000000:01000000:2.0:1787787370.331738:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787787370.331758:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.331766:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.331774:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787370.331786:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787370.331811:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.331828:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787370.331881:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503731840 00000100:00100000:1.0:1787787370.331889:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503731840 00000100:00100000:1.0:1787787370.331906:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787370.331922:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+6:17131:x1874630503731840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787370.331929:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787370.332046:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0800/0x11620bc3f30a9e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9e05 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.332066:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0800/0x11620bc3f30a9e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9e05 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.332375:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0800/0x11620bc3f30a9e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9e05 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.332385:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0800, rc 0) 00000100:00100000:1.0:1787787370.332416:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+7:17131:x1874630503731840:12345-0@lo:101:mount.lustre.0 Request processed in 494us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787370.332422:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787370.332498:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787370.332510:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.332518:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787370.332529:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787787370.332543:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.332550:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787370.332566:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787787370.332569:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787370.332574:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9870c5465000 10000000:01000000:2.0:1787787370.332577:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787787370.332579:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787787370.332581:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787787370.332595:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.332601:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.332608:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787370.332621:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787370.332645:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.332661:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.332722:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503731968 00000100:00100000:3.0:1787787370.332727:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503731968 00000100:00100000:3.0:1787787370.332746:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787370.332752:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+7:17131:x1874630503731968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787370.332760:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787370.332768:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f3e00/0x11620bc3f30a9e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9e13 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.332780:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f3e00/0x11620bc3f30a9e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9e13 expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.332794:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f3e00/0x11620bc3f30a9e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9e13 expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.332800:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3e00, rc 0) 00000100:00100000:3.0:1787787370.332834:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+8:17131:x1874630503731968:12345-0@lo:101:mount.lustre.0 Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.332840:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787370.333053:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503731968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787370.333064:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.333071:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787370.333432:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503732096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787370.333460:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.333486:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.333540:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503732096 00000100:00100000:3.0:1787787370.333544:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503732096 00000100:00100000:3.0:1787787370.333601:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787370.333609:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+8:17131:x1874630503732096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787370.333740:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17131:x1874630503732096:12345-0@lo:501:mount.lustre.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.333747:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787370.333951:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503732096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787370.333984:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503732224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787370.334025:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.334046:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.334228:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503732224 00000100:00100000:0.0:1787787370.334233:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503732224 00000100:00100000:0.0:1787787370.334273:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787370.334281:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17131:x1874630503732224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787370.335675:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17131:x1874630503732224:12345-0@lo:503:mount.lustre.0 Request processed in 1388us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787370.335696:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787370.335803:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503732224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787370.336898:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17170:1874630503732352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787370.337103:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787370.337522:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.337625:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503732352 00000100:00100000:3.0:1787787370.337633:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503732352 00000100:00100000:3.0:1787787370.337683:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787370.337692:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17170:x1874630503732352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787370.338894:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17170:x1874630503732352:12345-0@lo:502:llog_process_th.0 Request processed in 1198us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.338904:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787370.339051:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17170:1874630503732352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787370.339085:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787370.339097:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.339099:0:17170:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787787370.339104:0:17170:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787787370.339107:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787370.339132:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff986fc38c19b8) 00000020:00000080:0.0:1787787370.339173:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787787370.339180:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787787370.339489:0:17170:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787787370.339497:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9e28 00000020:00000080:0.0:1787787370.339717:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787787370.339723:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787370.339726:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.339728:0:17170:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787787370.339731:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787370.339735:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.339737:0:17170:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787787370.339740:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787370.339748:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff986fc38c3370) 00000020:00000080:0.0:1787787370.339759:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787787370.339763:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787787370.339765:0:17170:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787787370.339768:0:17170:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787787370.339774:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787370.339819:0:17170:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870c5465000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787787370.339831:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff986fc38c0000) 00000020:00000080:0.0:1787787370.339838:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787787370.339921:0:17170:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787787370.339928:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a9e3d 00000020:00000080:0.0:1787787370.340024:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787787370.340031:0:17170:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787787370.340036:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x11620bc3f30a9e44 00080000:01000000:0.0:1787787370.340042:0:17170:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787787370.340045:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9e4b 00010000:00010000:2.0:1787787370.408556:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787787370.409800:0:17170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787787370.410543:0:17170:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787787370.411177:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff987101db3370) 00000020:00000080:2.0:1787787370.411206:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787787370.411296:0:17170:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787787370.411303:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9e59 00000020:00000080:3.0:1787787370.418504:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787787370.421746:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x11620bc3f30a9e60 00000020:00000080:3.0:1787787370.422411:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787787370.422426:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787370.422432:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.422441:0:17170:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787787370.422445:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787787370.422448:0:17170:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787787370.422449:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787370.422451:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787370.422452:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787787370.422455:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.422457:0:17170:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787787370.422459:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787370.422464:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.422466:0:17170:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787787370.422470:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787787370.422511:0:17170:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787787370.422525:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787370.422528:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.422530:0:17170:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787787370.422532:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787370.422536:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.422537:0:17170:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787787370.422540:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787787370.422545:0:17170:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:00000080:3.0:1787787370.422572:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787370.422588:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9870f55f19b8) 00000020:00000080:3.0:1787787370.422601:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787787370.422606:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787787370.422660:0:17170:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787787370.422665:0:17170:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787787370.422671:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9e6e 00010000:00080000:3.0:1787787370.422700:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870ff9bd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787370.425727:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787787370.426937:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787787370.426962:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787787370.426998:0:17170:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787787370.427020:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a9e75 00000100:00080000:1.0:1787787370.427034:0:17170:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787370.427040:0:17170:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870ff9bd800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787370.427081:0:17170:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f70c0 x1874630503732480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787370.427116:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787787370.427234:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787370.427237:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787370.427239:0:17170:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787787370.427242:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787787370.427245:0:17170:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787787370.427247:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787787370.427258:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787787370.427260:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787787370.427262:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787370.427264:0:17170:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787787370.427266:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787370.427271:0:17170:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787787370.427274:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787370.427275:0:17170:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787787370.427278:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787787370.427282:0:17170:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:1.0:1787787370.427477:0:17170:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787787370.427479:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787370.427492:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9870fc368000) 00000020:00000080:1.0:1787787370.427504:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787787370.427508:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787787370.427573:0:17170:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787787370.427578:0:17170:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787787370.427584:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9e83 00010000:00080000:1.0:1787787370.427613:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870c3ecd000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787370.427804:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787787370.428261:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503732480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787370.428340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.428431:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503732480 00000100:00100000:3.0:1787787370.428439:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503732480 00000100:00100000:3.0:1787787370.428472:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787370.428478:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503732480:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787787370.428493:0:17157:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787787370.428532:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503732480:12345-0@lo:38:llog_process_th.0 Request processed in 52us (193us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787370.428538:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787787370.428570:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787370.428574:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787370.428577:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503732480:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1787787370.429615:0:17170:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787787370.430056:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787787370.434255:0:17170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787370.434660:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787787370.441409:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787787370.442560:0:17176:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787787370.442566:0:17176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787787370.443838:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787370.443851:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787787370.443891:0:17170:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787787370.444030:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a9e8a 00000100:00080000:3.0:1787787370.444044:0:17170:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787370.444050:0:17170:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9870c3ecd000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787370.444089:0:17170:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc41703c0 x1874630503732608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787370.444176:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503732608:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787787370.444244:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503732608 offset 0 length 520: 4 00000100:00080000:3.0:1787787370.444512:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787787370.444629:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787370.444634:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.444636:0:17170:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787787370.444639:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787787370.444642:0:17170:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787787370.444643:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787370.444645:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787370.444657:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787787370.444660:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.444661:0:17170:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787787370.444664:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787370.444669:0:17170:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787787370.444673:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.444674:0:17170:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787787370.444677:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787787370.444681:0:17170:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:3.0:1787787370.444703:0:17170:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787787370.444705:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787370.444718:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9870f55f3370) 00000020:00000080:3.0:1787787370.444732:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787787370.444737:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787787370.444797:0:17170:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787787370.444804:0:17170:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787787370.444810:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30a9e98 00010000:00080000:3.0:1787787370.444840:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff987101e37800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787370.445451:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787787370.445513:0:17170:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787787370.445528:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787787370.447799:0:17170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787370.448365:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787787370.448512:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787787370.449223:0:17178:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787787370.449228:0:17178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787787370.450113:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787370.450126:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787787370.450193:0:17170:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787787370.450225:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30a9e9f 00000100:00080000:3.0:1787787370.450237:0:17170:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787370.450245:0:17170:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff987101e37800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787370.450393:0:17170:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4173c00 x1874630503732736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787370.450463:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503732736:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787787370.450529:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503732736 offset 0 length 520: 4 00000100:00080000:3.0:1787787370.450587:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787787370.450656:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787370.450661:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.450663:0:17170:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787787370.450666:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787370.450670:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.450671:0:17170:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787370.450675:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787370.450676:0:17170:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787787370.450679:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787370.450681:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.450682:0:17170:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787787370.450684:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787370.450686:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.450687:0:17170:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787787370.450690:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787787370.450716:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17170:1874630503732864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787370.450763:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.450796:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503732864 00000100:00100000:3.0:1787787370.450802:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503732864 00000100:00100000:3.0:1787787370.450840:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787370.450848:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17170:x1874630503732864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787370.451159:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17170:x1874630503732864:12345-0@lo:502:llog_process_th.0 Request processed in 312us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.451168:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787370.451220:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.451239:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17170:1874630503732864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787370.451262:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787370.451271:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787370.451273:0:17170:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787787370.451277:0:17170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787787370.451459:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787787370.451482:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787787370.451496:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.451506:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787370.451514:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c5465000 from 1 10000000:01000000:3.0:1787787370.451517:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787787370.451542:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.451549:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.451559:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787370.451572:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503732992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787370.451602:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.451739:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.451763:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503732992 00000100:00100000:3.0:1787787370.451767:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503732992 00000100:00100000:3.0:1787787370.451793:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787370.451799:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+9:17131:x1874630503732992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787370.451808:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787370.451825:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9ea6 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.451848:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.451859:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.451867:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3c00, rc 0) 00000100:00100000:3.0:1787787370.451899:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+10:17131:x1874630503732992:12345-0@lo:101:mount.lustre.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.451918:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787370.452184:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503732992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787370.452207:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.452216:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787370.453174:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733120:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787787370.453240:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.453449:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733120 00000100:00100000:2.0:1787787370.453456:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733120 00000100:00100000:2.0:1787787370.453495:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787370.453504:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+10:17131:x1874630503733120:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787787370.453521:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787787370.453527:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787787370.453592:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+10:17131:x1874630503733120:12345-0@lo:256:mount.lustre.0 Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.453599:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787370.453725:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.453743:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733120:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787787370.455057:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787370.455161:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.455259:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787370.455268:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c5465000 from 1 10000000:01000000:3.0:1787787370.455271:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787370.455531:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.455540:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.455550:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787370.455570:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787370.455633:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.455669:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.455695:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733248 00000100:00100000:3.0:1787787370.455701:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733248 00000100:00100000:3.0:1787787370.455745:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787370.455753:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+10:17131:x1874630503733248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787370.455764:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787370.455776:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9eb4 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.455798:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 11 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.455821:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 11 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.455829:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3200, rc 0) 00000100:00100000:3.0:1787787370.455865:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17131:x1874630503733248:12345-0@lo:101:mount.lustre.0 Request processed in 112us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.455872:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787370.455935:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787370.456366:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.456376:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787370.456437:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787370.456464:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.456491:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787370.456584:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733376 00000100:00100000:2.0:1787787370.456588:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733376 00000100:00100000:2.0:1787787370.456616:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787787370.456622:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17131:x1874630503733376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787370.456749:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17131:x1874630503733376:12345-0@lo:501:mount.lustre.0 Request processed in 127us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.456756:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787787370.456814:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787370.456841:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787370.456876:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787370.456895:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.457027:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733504 00000100:00100000:3.0:1787787370.457031:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733504 00000100:00100000:3.0:1787787370.457059:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787370.457064:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17131:x1874630503733504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787370.457158:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17131:x1874630503733504:12345-0@lo:503:mount.lustre.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.457165:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787370.457346:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787370.457752:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17180:1874630503733632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787370.457797:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787370.457848:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787370.457874:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733632 00000100:00100000:2.0:1787787370.457877:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733632 00000100:00100000:2.0:1787787370.458032:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787370.458040:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17180:x1874630503733632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787370.458654:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17180:x1874630503733632:12345-0@lo:502:llog_process_th.0 Request processed in 613us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.458662:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787370.458766:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17180:1874630503733632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787370.458791:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787370.458800:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.458803:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787787370.458811:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870c5465000 00000020:00000080:0.0:1787787370.458813:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787370.458821:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787370.458823:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.458824:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787787370.458837:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787370.458839:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.458841:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787787370.458844:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870c5465000 00000020:00000080:0.0:1787787370.458845:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787370.459019:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787370.459023:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.459025:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787787370.459027:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787370.459030:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.459031:0:17180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787370.459034:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870c5465000 00000020:00000080:0.0:1787787370.459036:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787370.462408:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787370.468236:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.468245:0:17180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787370.468278:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787370.468480:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.468483:0:17180:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787787370.468491:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870c5465000 00000020:00000080:0.0:1787787370.468493:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787787370.468611:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17180:1874630503733760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787370.468689:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787370.468722:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733760 00000100:00100000:0.0:1787787370.468728:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733760 00000100:00100000:0.0:1787787370.468774:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787370.468782:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17180:x1874630503733760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787370.468896:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17180:x1874630503733760:12345-0@lo:502:llog_process_th.0 Request processed in 114us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787370.468903:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787370.469025:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.469051:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17180:1874630503733760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787370.469075:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787370.469079:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787370.469081:0:17180:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787787370.469085:0:17180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787787370.469172:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787787370.469188:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787370.469211:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.469222:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787370.470393:0:17131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787787370.470400:0:17131:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870c5465000 10000000:01000000:0.0:1787787370.470403:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870c5465000 10000000:01000000:0.0:1787787370.470407:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787370.470412:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c5465000 from 1 10000000:01000000:0.0:1787787370.470415:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787787370.470445:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.470456:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.470465:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787370.470483:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787370.470525:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787370.471055:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.471184:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503733888 00000100:00100000:0.0:1787787370.471190:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503733888 00000100:00100000:0.0:1787787370.472006:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787370.472023:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17131:x1874630503733888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787370.472038:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787370.472058:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a9ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9ec2 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.472084:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a9ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9ec2 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.472096:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a9ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ec2 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.472106:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14a00, rc 0) 00000100:00100000:0.0:1787787370.472182:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17131:x1874630503733888:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787370.475165:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503733888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787370.475208:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.475230:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787370.475336:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503734016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787370.475398:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.475441:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.475615:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734016 00000100:00100000:3.0:1787787370.475622:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734016 00000100:00100000:3.0:1787787370.475670:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787370.475679:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+13:17131:x1874630503734016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787370.475801:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+13:17131:x1874630503734016:12345-0@lo:501:mount.lustre.0 Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.475809:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787370.476385:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787370.477093:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503734016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787370.477179:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503734144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787370.477242:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.477414:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.477456:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734144 00000100:00100000:0.0:1787787370.477461:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734144 00000100:00100000:0.0:1787787370.477498:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787370.477505:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17131:x1874630503734144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787370.477592:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17131:x1874630503734144:12345-0@lo:503:mount.lustre.0 Request processed in 87us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787370.477599:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787370.477663:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503734144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787370.478073:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17184:1874630503734272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787370.478108:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.478297:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.486465:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734272 00000100:00100000:0.0:1787787370.486483:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734272 00000100:00100000:1.0:1787787370.486867:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787370.486879:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17184:x1874630503734272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787370.487067:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17184:x1874630503734272:12345-0@lo:502:llog_process_th.0 Request processed in 189us (8956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787370.487076:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787370.487941:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17184:1874630503734272:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787787370.488024:0:17184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787787370.488040:0:17184:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9870fc3699b8) 00000020:00000080:1.0:1787787370.488059:0:17184:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787787370.488176:0:17184:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870c5465000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787787370.488180:0:17184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c5465000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787787370.488183:0:17184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c5465000 4 00010000:00080000:1.0:1787787370.488231:0:17184:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc3a44000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787370.491847:0:17184:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787787370.492344:0:17184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787787370.492480:0:17184:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787370.492496:0:17184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x11620bc3f30a9ed7 00000100:00080000:1.0:1787787370.492507:0:17184:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787370.492513:0:17184:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff986fc3a44000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787370.492550:0:17184:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f5a40 x1874630503734400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787370.493273:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503734400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787370.493469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787370.493491:0:17184:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787787370.493872:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734400 00000100:00100000:2.0:1787787370.493880:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734400 00000100:00100000:2.0:1787787370.493912:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787370.493920:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503734400:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787370.496669:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503734400:12345-0@lo:38:llog_process_th.0 Request processed in 2743us (3195us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787787370.496682:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17184:1874630503734528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787370.496687:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787370.496751:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787370.496759:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc3a44000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787370.496764:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787370.496767:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503734400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787370.497072:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.498092:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.498104:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734528 00000100:00100000:0.0:1787787370.498118:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734528 00000100:00100000:1.0:1787787370.498315:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787370.498326:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17184:x1874630503734528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787370.498464:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17184:x1874630503734528:12345-0@lo:502:llog_process_th.0 Request processed in 139us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787370.498473:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787370.498529:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17184:1874630503734528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787370.498650:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17184:1874630503734656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787370.498685:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.498716:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.498722:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734656 00000100:00100000:0.0:1787787370.498726:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734656 00000100:00100000:0.0:1787787370.498767:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787370.498775:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17184:x1874630503734656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787370.498849:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17184:x1874630503734656:12345-0@lo:502:llog_process_th.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787370.498856:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787370.498932:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:655a2ac3-6e05-4716-af47-ef6019dc5f23:17184:1874630503734656:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787787370.498956:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787787370.499165:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787787370.499190:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787370.499298:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.499310:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787370.499362:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787370.499365:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787370.499367:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787370.499369:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787370.499370:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787370.499372:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787370.499373:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787370.499375:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787370.499377:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787370.499378:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787370.499383:0:17131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787787370.499386:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787370.499388:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787370.499389:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787370.499391:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787370.499392:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787370.499394:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787370.499395:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787370.499401:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787370.499402:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787370.499403:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787370.499417:0:17131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787787370.499426:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503734784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787370.499458:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787370.499489:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787370.499784:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734784 00000100:00100000:3.0:1787787370.499790:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734784 00000100:00100000:3.0:1787787370.499828:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787370.499836:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17131:x1874630503734784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787787370.499858:0:17146:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787787370.499871:0:17146:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787787370.504061:0:17146:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787370.504083:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787787370.504230:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787787370.504235:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787787370.504257:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.504277:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787370.504391:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.504523:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.504542:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787370.504547:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17131:x1874630503734784:12345-0@lo:253:mount.lustre.0 Request processed in 4708us (5084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.504561:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787370.504573:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503734912:0@lo:104: 00000100:00100000:1.0:1787787370.504619:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.504661:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787370.505054:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17131:1874630503734784:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787370.505066:0:17131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787787370.505070:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787370.505072:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787370.505073:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787370.505075:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787370.505076:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787370.505078:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787370.505079:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787370.505081:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787370.505083:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787370.505085:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787787370.505100:0:17131:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787787370.505414:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503734912 00000100:00100000:3.0:1787787370.505422:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503734912 00000100:00100000:3.0:1787787370.505471:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787370.505479:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503734912:12345-0@lo:104: 00010000:00010000:3.0:1787787370.505494:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.505554:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787370.505560:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503734912:12345-0@lo:104: Request processed in 82us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787370.505566:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787370.505596:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503734912:0@lo:104: 00010000:00010000:3.0:1787787370.505612:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.505729:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787370.505736:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.505745:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787370.505749:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.505757:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787370.505765:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787370.505770:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787370.505804:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.505811:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787370.505838:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.505855:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f2c00/0x11620bc3f30a9ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ead expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.505874:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.505876:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787370.505878:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787370.505919:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503735040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787370.505957:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787370.506007:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735040 00000100:00100000:1.0:1787787370.506012:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735040 00010000:00010000:1.0:1787787370.506029:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787370.506053:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787370.506060:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:3654:x1874630503735040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787370.506071:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787370.506077:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506088:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506103:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f3c00/0x11620bc3f30a9ead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9ea6 expref: 12 pid: 17146 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506116:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506134:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787370.506168:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001933789s 00010000:00010000:1.0:1787787370.506173:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506180:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506188:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506206:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506222:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787370.506226:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506233:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506246:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787370.506255:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787370.506287:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:3654:x1874630503735040:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787370.506294:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787370.506331:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503735040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787370.506485:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.506494:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.506500:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9ede lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787787370.535835:0:17131:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787787370.536396:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787787370.536658:0:17192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787787370.537192:0:17192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787787370.538227:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1787787370.539556:0:17193:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff986fc4283480 x1874630503735168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787370.539588:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00000040:01000000:1.0:1787787370.540656:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787787370.540709:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787787370.541418:0:17191:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787787370.541424:0:17191:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1787787370.542278:0:17131:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787787370.542536:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787787370.542615:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787370.543500:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787787370.543572:0:17192:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1787787370.548573:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787787370.552826:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787787370.553133:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787787370.554812:0:17131:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1787787370.557476:0:17131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787787370.558899:0:17131:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787787370.558958:0:17131:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6224193f988 00100000:10000000:1.0:1787787370.558966:0:17131:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787787370.559830:0:17131:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787787370.559848:0:17131:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787787370.559867:0:17131:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787787370.559895:0:17131:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787787370.561165:0:17131:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787370.561565:0:17131:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787787371.242814:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787787371.243086:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787371.243092:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c5465000 from 7 10000000:01000000:2.0:1787787371.243096:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787371.243160:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787371.243173:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787371.243194:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787371.243220:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503735296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787371.243289:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787371.243341:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735296 00000100:00100000:2.0:1787787371.243342:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787371.243350:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735296 00000100:00100000:0.0:1787787371.243567:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787371.243651:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+11:17149:x1874630503735296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787371.243665:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787371.243679:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9ee5 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787371.243702:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787371.243714:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787371.243725:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15c00, rc 0) 00000100:00100000:0.0:1787787371.244167:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17149:x1874630503735296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 488us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787371.244175:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787371.244635:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503735296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787371.244654:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787371.244665:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787371.244726:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503735424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787787371.244765:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787371.244798:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787371.244844:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735424 00000100:00100000:3.0:1787787371.244850:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735424 00000100:00100000:3.0:1787787371.244891:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787371.244908:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17149:x1874630503735424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787787371.244925:0:17146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787787371.245093:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787787371.245097:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787787371.245246:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17149:x1874630503735424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 339us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787371.245255:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787371.245319:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503735424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787787371.245365:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787371.245372:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787371.245383:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787371.497860:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787371.561498:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787787372.265323:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787372.529106:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787787372.594256:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787787373.291363:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787373.612572:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787787374.316801:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787787374.338987:0:17436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787787374.639438:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00000020:00000004:1.0:1787787375.198932:0:17488:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787375.200079:0:17488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787787375.338436:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787375.657215:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00000020:00000004:3.0:1787787375.926845:0:17538:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787375.927062:0:17538:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1787787375.977373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787787375.977380:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787787375.977384:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787375.977391:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1787787375.977397:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787375.977404:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870ff9bd800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787375.977430:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f4b40 x1874630503735680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787375.977449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787375.977462:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787375.977464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787375.977467:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787375.977470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787787375.977472:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787787375.977474:0:36:0:(import.c:65:import_set_state_nolock()) ffff986fc3a44000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787375.977480:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff986fc3a44000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787375.977495:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f52c0 x1874630503735808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787375.977544:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787375.977559:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503735552:0@lo:400:kworker.0 00000100:00100000:1.0:1787787375.977632:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787375.977699:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503735680:0@lo:38:kworker.0 00000100:00100000:2.0:1787787375.977715:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735552 00000100:00100000:2.0:1787787375.977725:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735552 00000100:00100000:1.0:1787787375.977734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787375.977757:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503735808:0@lo:38:kworker.0 00000100:00100000:2.0:1787787375.977777:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787375.977788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787375.977799:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:3656:x1874630503735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787375.977833:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735808 00000100:00100000:1.0:1787787375.977838:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735808 00000100:00100000:1.0:1787787375.977864:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787375.977871:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503735808:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787787375.977875:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:3656:x1874630503735552:12345-0@lo:400:kworker.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787375.977885:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787787375.977897:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1787787375.977935:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x11620bc3f30a9ef3 00000004:00100000:1.0:1787787375.977951:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787787375.978102:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787375.978192:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735680 00000100:00100000:3.0:1787787375.978198:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735680 00000100:00100000:3.0:1787787375.978219:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787375.978225:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503735680:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787787375.978238:0:17157:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787787375.980068:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874630503735808:12345-0@lo:38:kworker.0 Request processed in 2189us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787375.980082:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787375.980178:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503735552:0@lo:400:kworker.0 00010000:00080000:2.0:1787787375.980335:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9870fc3f52c0 x1874630503735808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787375.980354:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787787375.980363:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787787375.980368:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787375.980372:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc3a44000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787375.980378:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503735808:0@lo:38:kworker.0 00000100:00100000:3.0:1787787376.014745:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503735680:12345-0@lo:38:kworker.0 Request processed in 36509us (37001us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787376.014760:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787787376.014838:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787376.014845:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787376.014849:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503735680:0@lo:38:kworker.0 00010000:00010000:2.0:1787787376.362345:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787376.682292:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787787377.386958:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787377.705778:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787787378.409309:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787378.731322:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787787379.433410:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787379.760160:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00000100:00100000:2.0:1787787380.073712:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787370/real 1787787370] req@ffff986fc4173c00 x1874630503732736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787380 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787380.073748:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4173c00 x1874630503732736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787380 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787380.073759:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787370/real 1787787370] req@ffff986fc41703c0 x1874630503732608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787380 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787380.073769:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc41703c0 x1874630503732608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787380 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787380.073814:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787380.073844:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787787380.073849:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503732736:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787787380.073855:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787380.073860:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787787380.073863:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503732608:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787787380.075089:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787787380.075095:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787787380.075099:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787380.075105:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1787787380.075111:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787787380.075117:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870ff9bd800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787380.075173:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f7480 x1874630503736064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787380.075187:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787380.075190:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787787380.075192:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787380.075195:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1787787380.075197:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787380.075200:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9870c3ecd000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787380.075211:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f7c00 x1874630503736192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787380.075220:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787380.075222:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787787380.075224:0:38:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787380.075227:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1787787380.075235:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787380.075239:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff987101e37800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787380.075249:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc3f4780 x1874630503736320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787380.075288:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787380.075305:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503736448:0@lo:400:kworker.0 00000100:00100000:1.0:1787787380.075368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787380.075452:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787380.075464:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503735936:0@lo:400:kworker.0 00000100:00100000:3.0:1787787380.075502:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.075686:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503736448 00000100:00100000:2.0:1787787380.075694:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503736448 00000100:00100000:2.0:1787787380.075749:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787380.075759:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503736448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.075950:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503736448:12345-0@lo:400:kworker.0 Request processed in 192us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787380.075958:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787380.075983:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503736064:0@lo:38:kworker.0 00000100:00100000:2.0:1787787380.076028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.076049:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503736192:0@lo:8:kworker.0 00000400:00000100:2.0:1787787380.076072:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503736192 offset 0 length 520: 4 00000100:00100000:2.0:1787787380.076084:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503736320:0@lo:8:kworker.0 00000400:00000100:2.0:1787787380.076103:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503736320 offset 0 length 520: 4 00000100:00100000:2.0:1787787380.076154:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503736064 00000100:00100000:2.0:1787787380.076158:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503736064 00000100:00100000:2.0:1787787380.076175:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787380.076181:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503736064:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787787380.076208:0:17158:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787787380.076339:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9870fc3f6580 x1874630503736448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787380.076354:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503736448:0@lo:400:kworker.0 00000100:00100000:1.0:1787787380.076924:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735936 00000100:00100000:1.0:1787787380.076930:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735936 00000100:00100000:1.0:1787787380.076968:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787380.076976:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:3655:x1874630503735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787380.077042:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:3655:x1874630503735936:12345-0@lo:400:kworker.0 Request processed in 67us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787380.077049:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787380.077131:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503735936:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.099036:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503736064:12345-0@lo:38:kworker.0 Request processed in 22845us (22998us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787380.099052:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787787380.099110:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787380.099118:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787787380.099122:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503736064:0@lo:38:kworker.0 00010000:00010000:2.0:1787787380.457259:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787380.780454:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787787381.481298:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787381.801272:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00000020:01000004:3.0:1787787382.324893:0:17883:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787382.324899:0:17883:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787787382.324900:0:17883:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787787382.325042:0:17883:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff987101e33000 00000020:01000004:3.0:1787787382.325058:0:17883:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787787382.325069:0:17883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787787382.325833:0:17883:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9870d22f19b8) 00000020:00000080:3.0:1787787382.325855:0:17883:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787787382.385886:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.387945:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787787382.389095:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787787382.389487:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787787382.389733:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787787382.390214:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787787382.390530:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787787382.390824:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787787382.391217:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787787382.391396:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787787382.391788:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787787382.391955:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787787382.392281:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787787382.392518:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787787382.392947:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.393275:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.393888:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.394176:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.394380:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.394714:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.394946:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.395263:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.395514:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.395897:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.396229:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.396537:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787787382.396896:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787787382.397124:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.397986:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.398331:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.398736:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.398938:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.399245:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.399458:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.399670:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.399835:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.400081:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.400559:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.400864:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.401081:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.401493:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.401716:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.401887:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787787382.402107:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.402542:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787787382.402831:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00080000:01000000:3.0:1787787382.405841:0:17883:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787787382.406111:0:17883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787787382.406123:0:17883:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787787382.406182:0:17883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a9f01 00000020:01000004:3.0:1787787382.406190:0:17883:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787787382.406213:0:17883:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787787382.406217:0:17883:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787787382.406223:0:17883:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787787382.406250:0:17883:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787787382.406254:0:17883:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787787382.410566:0:17883:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787382.410666:0:17883:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.131@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787787382.410671:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787382.410673:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787382.410674:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787382.410676:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787382.410678:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787382.410679:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787382.410681:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787382.410682:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787382.410684:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787382.410687:0:17883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787787382.410690:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787382.410691:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787382.410692:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787382.410693:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787382.410694:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787382.410695:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787382.410696:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787382.410697:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787382.410702:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787382.410729:0:17883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787787382.410749:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787382.410822:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.410944:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503736576 00000100:00100000:2.0:1787787382.410953:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503736576 00000100:00100000:2.0:1787787382.411032:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787382.411042:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17883:x1874630503736576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787787382.411081:0:17146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787787382.411085:0:17146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787787382.411092:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787787382.411270:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787382.411651:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17883:x1874630503736576:12345-0@lo:253:mount.lustre.0 Request processed in 609us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.411661:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787787382.411756:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787787382.411768:0:17883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787787382.411771:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787382.411773:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787787382.411775:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787382.411776:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787382.411777:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787382.411779:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787382.411780:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787382.411782:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787382.411783:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787787382.411805:0:17883:0:(tgt_mount.c:101:server_register_mount()) register mount ffff987101e33000 from lustre-MDT0001 10000000:01000000:3.0:1787787382.411838:0:17883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787787382.411842:0:17883:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787787382.411849:0:17883:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9870fc36b370 local copy 00010000:00010000:3.0:1787787382.411859:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.411991:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787382.412036:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.412106:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503736704 00000100:00100000:2.0:1787787382.412111:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503736704 00000100:00100000:2.0:1787787382.412166:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787382.412175:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17883:x1874630503736704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787382.412237:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17883:x1874630503736704:12345-0@lo:501:mount.lustre.0 Request processed in 63us (200us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787382.412244:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787787382.412671:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787382.412689:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736704:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787787382.412704:0:17883:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787787382.412725:0:17883:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787787382.412733:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.412749:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787382.412776:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff987101e33000 10000000:01000000:3.0:1787787382.412781:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787787382.412786:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9870fc36b370 10000000:01000000:3.0:1787787382.412789:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787787382.412793:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9870fc36b370 from 1 10000000:01000000:3.0:1787787382.412795:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787787382.412818:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.412827:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.412838:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.412852:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787382.412883:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.412950:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787382.413119:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503736832 00000100:00100000:2.0:1787787382.413124:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503736832 00000100:00100000:2.0:1787787382.413281:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787382.413290:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+12:17883:x1874630503736832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787382.413309:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787382.413325:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2000/0x11620bc3f30a9f0f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9f08 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.413348:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2000/0x11620bc3f30a9f0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9f08 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.413369:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2000/0x11620bc3f30a9f0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9f08 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.413379:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2000, rc 0) 00000100:00100000:2.0:1787787382.413453:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+13:17883:x1874630503736832:12345-0@lo:101:mount.lustre.0 Request processed in 164us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.413460:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787382.413559:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787382.413571:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.413580:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787382.413604:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787787382.413730:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.413739:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787382.413747:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff987101e33000 10000000:01000000:0.0:1787787382.413751:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787787382.413755:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff987101e33000 from 1 10000000:01000000:0.0:1787787382.413757:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787787382.413775:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.413789:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.413797:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787382.413811:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4280b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787382.413844:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.413876:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787382.413927:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503736960 00000100:00100000:3.0:1787787382.413932:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503736960 00000100:00100000:3.0:1787787382.413978:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787787382.413986:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+13:17883:x1874630503736960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787382.413995:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787382.414004:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f2a00/0x11620bc3f30a9f1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9f16 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.414043:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f2a00/0x11620bc3f30a9f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9f16 expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.414051:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f2a00/0x11620bc3f30a9f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9f16 expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.414057:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2a00, rc 0) 00000100:00100000:3.0:1787787382.414280:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+14:17883:x1874630503736960:12345-0@lo:101:mount.lustre.0 Request processed in 294us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.414288:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787382.414370:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4280b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503736960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787382.414382:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.414390:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787382.414402:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787787382.414737:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.414746:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787382.414752:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787787382.414755:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787382.414761:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff987101e33000 10000000:01000000:0.0:1787787382.414764:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787787382.414773:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787787382.414775:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787787382.414793:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.414800:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.414807:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787382.414821:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4280b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787382.414850:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.414881:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787382.414928:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737088 00000100:00100000:3.0:1787787382.414933:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737088 00000100:00100000:3.0:1787787382.414994:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787382.415001:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+14:17883:x1874630503737088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787382.415010:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787382.415032:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f2c00/0x11620bc3f30a9f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9f24 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.415047:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f2c00/0x11620bc3f30a9f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9f24 expref: 15 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.415056:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f2c00/0x11620bc3f30a9f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9f24 expref: 15 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.415062:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f2c00, rc 0) 00000100:00100000:3.0:1787787382.415172:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737088:12345-0@lo:101:mount.lustre.0 Request processed in 171us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.415178:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787382.418289:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4280b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787382.418322:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.418336:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787382.421338:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787787382.423484:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787382.431548:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787787382.432200:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787787382.432222:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787787382.432238:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787787382.432254:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787787382.432270:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787787382.432299:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787787382.432320:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787787382.432336:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787787382.432352:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787787382.432541:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787787382.432560:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787787382.432578:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787787382.433006:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787787382.433030:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787787382.433044:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787787382.433058:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787787382.433073:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787787382.433087:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787787382.433100:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787787382.433113:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787787382.433127:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787787382.433263:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787787382.433304:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787787382.433310:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787787382.433421:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787382.433493:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.433539:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787382.433681:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737216 00000100:00100000:3.0:1787787382.433689:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737216 00000100:00100000:3.0:1787787382.433787:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787382.433798:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787382.433949:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737216:12345-0@lo:501:mount.lustre.0 Request processed in 153us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.433957:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787382.434001:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787382.434032:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787382.434069:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.436987:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787382.437491:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737344 00000100:00100000:3.0:1787787382.437500:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737344 00000100:00100000:3.0:1787787382.437799:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787382.437810:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787382.438706:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787382.439130:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737344:12345-0@lo:503:mount.lustre.0 Request processed in 784us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.439161:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:2.0:1787787382.439468:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787382.439545:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787382.439666:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.439745:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787382.439778:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737472 00000100:00100000:0.0:1787787382.439783:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737472 00000100:00100000:0.0:1787787382.439823:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787382.439831:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787382.440774:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737472:12345-0@lo:502:mount.lustre.0 Request processed in 939us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.440786:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787382.440863:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787382.442264:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787787382.442333:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1787787382.442349:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1787787382.442667:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1787787382.442685:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1787787382.442697:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1787787382.442708:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1787787382.442719:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1787787382.442730:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1787787382.442741:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1787787382.442752:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1787787382.442763:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1787787382.442774:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1787787382.442785:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1787787382.442797:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1787787382.442807:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1787787382.442819:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1787787382.442831:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1787787382.442843:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1787787382.442855:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1787787382.442866:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1787787382.442878:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1787787382.442891:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1787787382.442906:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1787787382.442919:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1787787382.442933:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1787787382.442947:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1787787382.442961:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1787787382.442998:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1787787382.443013:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1787787382.443038:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1787787382.443050:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1787787382.443062:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1787787382.443499:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1787787382.443523:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1787787382.443535:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1787787382.443546:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1787787382.443557:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1787787382.443570:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1787787382.443583:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1787787382.443604:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1787787382.443618:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1787787382.443639:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1787787382.443651:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1787787382.443697:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787382.443768:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.443808:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2b93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787382.443918:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737600 00000100:00100000:2.0:1787787382.443926:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737600 00000100:00100000:2.0:1787787382.443984:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787382.443993:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787382.444116:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503737600:12345-0@lo:502:mount.lustre.0 Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.444123:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787382.444289:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503737600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787382.444332:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1787787382.444340:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787787382.445011:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787382.445023:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.445025:0:17887:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787787382.445034:0:17887:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787787382.445036:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787382.445050:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff986fc38c4d28) 00000020:00000080:0.0:1787787382.445129:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787787382.445165:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787787382.445238:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787382.445246:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a9f39 00000020:00000080:0.0:1787787382.445548:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787787382.445553:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787382.445556:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.445558:0:17887:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787787382.445561:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787382.445564:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.445566:0:17887:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787787382.445569:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787382.445577:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9870f458b370) 00000020:00000080:0.0:1787787382.445587:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787787382.445714:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787787382.445717:0:17887:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787787382.445720:0:17887:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787787382.445739:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787382.445793:0:17887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff987101e33000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787787382.445805:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9870f458cd28) 00000020:00000080:0.0:1787787382.445815:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787787382.445868:0:17887:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787787382.445872:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a9f4e 00000020:00000080:0.0:1787787382.445989:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787787382.445997:0:17887:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787787382.446001:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x11620bc3f30a9f55 00080000:01000000:0.0:1787787382.446007:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787787382.446010:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a9f5c 00010000:00010000:0.0:1787787382.501713:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1787787382.502250:0:17887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1787787382.502534:0:17887:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787787382.503614:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787787382.503629:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787382.503636:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787382.503638:0:17887:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787787382.503642:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787382.503647:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787382.503649:0:17887:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787787382.503652:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787787382.503658:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:00000080:1.0:1787787382.503688:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787382.503704:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9870fc36cd28) 00000020:00000080:1.0:1787787382.503725:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1787787382.503736:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787787382.503800:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787787382.503807:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787787382.503814:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a9f6a 00010000:00080000:1.0:1787787382.503843:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870fc38a800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787382.505523:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00010000:00010000:2.0:1787787382.508651:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787787382.509303:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787787382.509318:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787787382.509359:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787787382.509380:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a9f71 00000100:00080000:3.0:1787787382.509391:0:17887:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787382.509397:0:17887:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9870fc38a800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787382.509430:0:17887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4170780 x1874630503737728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787382.509455:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787787382.509483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787787382.509488:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787787382.509491:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787382.509495:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787787382.509508:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787787382.509512:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870ff9bd800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787382.509535:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc41730c0 x1874630503737856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787382.509544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787382.509547:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787382.509550:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787382.509553:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787382.509588:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503737984:0@lo:400:kworker.0 00000100:00100000:3.0:1787787382.509787:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.509863:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737984 00000100:00100000:3.0:1787787382.509869:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737984 00000100:00100000:3.0:1787787382.509910:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787382.509919:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787382.509977:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503737984:12345-0@lo:400:kworker.0 Request processed in 60us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.509984:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787787382.510023:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc4171680 x1874630503737984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787382.510038:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503737984:0@lo:400:kworker.0 00000020:01000000:3.0:1787787382.510243:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787382.510247:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.510250:0:17887:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787787382.510253:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787787382.510255:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787787382.510263:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787382.510265:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787382.510267:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787787382.510269:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.510270:0:17887:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787787382.510272:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787382.510277:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.510278:0:17887:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787787382.510281:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787787382.510313:0:17887:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787787382.510325:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787382.510327:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.510329:0:17887:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787787382.510331:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787787382.510333:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787787382.510334:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787382.510335:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787382.510337:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787787382.510339:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.510340:0:17887:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787787382.510342:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787382.510345:0:17887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787787382.510348:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.510350:0:17887:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787787382.510352:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787787382.510356:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:3.0:1787787382.510375:0:17887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787787382.510377:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787382.510390:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9870d22f3370) 00000020:00000080:3.0:1787787382.510403:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787787382.510407:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787787382.510465:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787787382.510471:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787787382.510479:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a9f7f 00010000:00080000:3.0:1787787382.510505:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870f3637800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.131@tcp at head 00000100:00100000:2.0:1787787382.510714:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503737728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787382.510756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.510790:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503737856:0@lo:38:kworker.0 00000100:00100000:2.0:1787787382.510808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.510834:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737728 00000100:00100000:2.0:1787787382.510838:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737728 00000100:00100000:2.0:1787787382.510852:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503737856 00000100:00100000:2.0:1787787382.510854:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503737856 00000100:00100000:2.0:1787787382.510872:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787382.510878:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503737728:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787787382.510899:0:17158:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1787787382.510926:0:17158:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a9f86 00000004:00100000:2.0:1787787382.510940:0:17158:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787787382.510946:0:17158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787787382.511325:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1787787382.512302:0:17887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787787382.512476:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787787382.517236:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787382.518249:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787787382.518412:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:3.0:1787787382.518838:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9870fc38e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787382.518930:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503737728:12345-0@lo:38:llog_process_th.0 Request processed in 8048us (8171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.518941:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787382.518983:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787382.518989:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503737856:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787787382.519045:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503737856:12345-0@lo:38:kworker.0 Request processed in 55us (8235us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787787382.519051:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787382.519105:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787382.519115:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787787382.519125:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787787382.519130:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787787382.519133:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787382.519170:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503737728:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787382.519184:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787382.519188:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787382.519192:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787382.519195:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503737856:0@lo:38:kworker.0 00000100:00100000:3.0:1787787382.519259:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503738112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787382.519292:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.519338:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503738112 00000100:00100000:3.0:1787787382.519343:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503738112 00000100:00100000:3.0:1787787382.519373:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787382.519378:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503738112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787382.519400:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787787382.519433:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1874630503738112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787382.519438:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:0.0:1787787382.519642:0:17892:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787787382.519646:0:17892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787787382.523186:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503738112:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1787787382.523794:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787787382.523807:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787382.523858:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787787382.523880:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a9f8d 00000100:00080000:0.0:1787787382.523890:0:17887:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787382.523897:0:17887:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9870f3637800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787382.523932:0:17887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4282d00 x1874630503738240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787382.523960:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787787382.524023:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787382.524027:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.524029:0:17887:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787787382.524041:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787787382.524044:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787787382.524046:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787382.524047:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787382.524049:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787787382.524052:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.524053:0:17887:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787787382.524055:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787382.524059:0:17887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787787382.524062:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.524064:0:17887:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787787382.524066:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787382.524247:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:0.0:1787787382.524274:0:17887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787787382.524276:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787382.524288:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9870f45899b8) 00000020:00000080:0.0:1787787382.524301:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787787382.524305:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787382.524362:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787787382.524368:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787787382.524372:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30a9f9b 00010000:00080000:0.0:1787787382.524409:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870f576d800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787382.524607:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787787382.524674:0:17887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787787382.524688:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787787382.526242:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787787382.526444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787382.526450:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787382.526453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787382.526456:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787382.526490:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503738240:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787787382.526540:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503738240 offset 0 length 520: 4 00000040:00080000:0.0:1787787382.526712:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787787382.526851:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787787382.528432:0:17894:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787787382.528439:0:17894:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787787382.529793:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787787382.529807:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787382.529844:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787787382.529864:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30a9fa2 00000100:00080000:0.0:1787787382.529873:0:17887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787382.529887:0:17887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870f576d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787382.529921:0:17887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4281680 x1874630503738368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787382.529985:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503738368:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787787382.530054:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503738368 offset 0 length 520: 4 00000100:00080000:0.0:1787787382.530323:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787787382.530380:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787382.530384:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.530386:0:17887:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787787382.530389:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787382.530393:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.530394:0:17887:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787382.530397:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787382.530399:0:17887:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787787382.530401:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787382.530403:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.530404:0:17887:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787787382.530407:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787382.530409:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.530410:0:17887:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787787382.530413:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787787382.530438:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787382.530441:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787382.530442:0:17887:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787787382.530445:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1787787382.530551:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787787382.530581:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787787382.530666:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.530678:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787382.530686:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff987101e33000 from 1 10000000:01000000:0.0:1787787382.530696:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787382.530723:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.530731:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.530741:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787382.530757:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787382.530805:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.530825:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787382.530846:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503738496 00000100:00100000:0.0:1787787382.530852:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503738496 00000100:00100000:0.0:1787787382.530895:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787382.530904:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+15:17883:x1874630503738496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787382.530916:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787382.530929:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9fa9 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.530954:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.530976:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.530984:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15800, rc 0) 00000100:00100000:0.0:1787787382.531033:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17883:x1874630503738496:12345-0@lo:101:mount.lustre.0 Request processed in 129us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.531049:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787787382.531179:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787382.531185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787382.531187:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787382.531190:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787787382.531275:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787382.531289:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.531298:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787382.531994:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738624:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787787382.532041:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.532206:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.532475:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503738624 00000100:00100000:1.0:1787787382.532482:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503738624 00000100:00100000:2.0:1787787382.532703:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787382.532724:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17883:x1874630503738624:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787787382.532742:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787787382.532760:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787787382.532763:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787787382.533008:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17883:x1874630503738624:12345-0@lo:256:mount.lustre.0 Request processed in 285us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.533024:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787382.533454:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738624:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787787382.534443:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787382.534503:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.534514:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787382.534522:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff987101e33000 from 1 10000000:01000000:0.0:1787787382.534525:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787382.534559:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.534567:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.534576:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787382.534619:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787382.534668:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.534741:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787382.534836:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503738752 00000100:00100000:2.0:1787787382.534843:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503738752 00000100:00100000:2.0:1787787382.534887:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787382.534896:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17883:x1874630503738752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787382.534907:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787382.534919:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9fb7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.534942:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.534953:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.534962:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3800, rc 0) 00000100:00100000:2.0:1787787382.535206:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503738752:12345-0@lo:101:mount.lustre.0 Request processed in 310us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.535212:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787382.535367:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787382.535382:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.535390:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787382.535536:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787382.535567:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787382.535609:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.535638:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787382.535745:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503738880 00000100:00100000:0.0:1787787382.535750:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503738880 00000100:00100000:0.0:1787787382.535786:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787382.535794:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503738880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787382.535871:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503738880:12345-0@lo:501:mount.lustre.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.535878:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787382.535990:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503738880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787382.536013:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787382.536058:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.536187:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787382.536368:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739008 00000100:00100000:0.0:1787787382.536372:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739008 00000100:00100000:0.0:1787787382.536434:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787382.536441:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787382.536531:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739008:12345-0@lo:503:mount.lustre.0 Request processed in 90us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.536538:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787382.536615:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787382.536979:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787382.537066:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787382.537319:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.537508:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787382.537584:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739136 00000100:00100000:2.0:1787787382.537598:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739136 00000100:00100000:2.0:1787787382.537629:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787382.537637:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787382.537747:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739136:12345-0@lo:502:mount.lustre.0 Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.537754:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787382.537880:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787382.538181:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787787382.538210:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1787787382.538223:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1787787382.538249:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1787787382.538262:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1787787382.538274:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1787787382.538285:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1787787382.538297:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1787787382.538308:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787787382.538319:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1787787382.538331:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1787787382.538361:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787382.538399:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.538418:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f11540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787382.538587:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739264 00000100:00100000:2.0:1787787382.538602:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739264 00000100:00100000:2.0:1787787382.538627:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787382.538634:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787382.538712:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739264:12345-0@lo:502:mount.lustre.0 Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787382.538719:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787382.538877:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787382.538923:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1787787382.538932:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787787382.539496:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787382.539506:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539508:0:17896:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787382.539516:0:17896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff987101e33000 00000020:00000080:3.0:1787787382.539518:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787382.539529:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787382.539531:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539532:0:17896:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787787382.539534:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787382.539537:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539538:0:17896:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787382.539541:0:17896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff987101e33000 00000020:00000080:3.0:1787787382.539543:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787382.539609:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787382.539613:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539615:0:17896:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787787382.539617:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787382.539619:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539621:0:17896:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787382.539625:0:17896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff987101e33000 00000020:00000080:3.0:1787787382.539627:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787382.539645:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787382.539648:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539650:0:17896:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787382.539652:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787382.539661:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539662:0:17896:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787787382.539667:0:17896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff987101e33000 00000020:00000080:3.0:1787787382.539669:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787382.539694:0:17896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787382.539697:0:17896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787382.539698:0:17896:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787787382.539701:0:17896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787787382.539737:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787787382.539760:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787382.539777:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.539788:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787382.539833:0:17883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787787382.539836:0:17883:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff987101e33000 10000000:01000000:3.0:1787787382.539839:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff987101e33000 10000000:01000000:3.0:1787787382.539842:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787382.539848:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff987101e33000 from 1 10000000:01000000:3.0:1787787382.539851:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787382.539882:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.539890:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.539902:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.539922:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787382.540005:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.540047:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c9b76000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787382.543412:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739392 00000100:00100000:0.0:1787787382.543430:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739392 00000100:00100000:0.0:1787787382.543498:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787382.543507:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17883:x1874630503739392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787382.543525:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787382.543543:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14000/0x11620bc3f30a9fcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9fc5 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.543571:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14000/0x11620bc3f30a9fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9fc5 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.543652:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14000/0x11620bc3f30a9fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fc5 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787382.543664:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14000, rc 0) 00000100:00100000:0.0:1787787382.543802:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739392:12345-0@lo:101:mount.lustre.0 Request processed in 296us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.543811:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787382.553235:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787382.553272:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.553287:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787382.556501:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787787382.558045:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787382.558889:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787787382.558919:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787787382.558934:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787787382.558949:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787787382.558979:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787787382.558995:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787787382.559009:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787787382.559021:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787787382.559035:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787787382.559048:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787787382.559062:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787787382.560207:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787787382.560238:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787787382.560251:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787787382.560266:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787787382.560281:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787787382.560295:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787787382.560309:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787787382.560323:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787787382.560338:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787787382.560369:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787787382.560384:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787787382.560398:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787787382.560412:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787787382.560423:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787787382.560436:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787787382.560448:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787787382.560474:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787787382.560498:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787787382.560503:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787787382.561721:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787382.561816:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.563444:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8191300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.563870:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739520 00000100:00100000:1.0:1787787382.563890:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739520 00000100:00100000:1.0:1787787382.563943:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787382.563953:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787382.564339:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739520:12345-0@lo:501:mount.lustre.0 Request processed in 386us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.564348:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787787382.565032:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787382.565110:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787382.565187:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.565210:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739648 00000100:00100000:3.0:1787787382.565214:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8191300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.565216:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739648 00000100:00100000:1.0:1787787382.565253:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787382.565261:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787382.565374:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739648:12345-0@lo:503:mount.lustre.0 Request processed in 112us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.565393:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787787382.565695:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787382.566264:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787382.566338:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787382.566394:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.566419:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8191300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.567303:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739776 00000100:00100000:1.0:1787787382.567314:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739776 00000100:00100000:1.0:1787787382.567378:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787382.567390:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787382.567540:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739776:12345-0@lo:502:mount.lustre.0 Request processed in 152us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.567548:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787382.568223:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787382.568439:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787787382.568470:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1787787382.568486:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1787787382.568501:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1787787382.568525:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1787787382.568539:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1787787382.568552:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1787787382.568563:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1787787382.568575:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1787787382.570191:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1787787382.570281:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1787787382.570298:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1787787382.570331:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1787787382.570346:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1787787382.570359:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1787787382.570372:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1787787382.570383:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1787787382.570395:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1787787382.570408:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1787787382.570421:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1787787382.570434:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1787787382.570447:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1787787382.570459:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1787787382.570471:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1787787382.570483:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1787787382.570496:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1787787382.570509:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1787787382.570522:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1787787382.570546:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1787787382.570562:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1787787382.570576:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1787787382.570724:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1787787382.570749:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1787787382.570762:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1787787382.570775:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1787787382.570786:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1787787382.570799:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1787787382.570823:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1787787382.570839:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1787787382.570852:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1787787382.570865:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1787787382.570878:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1787787382.570893:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1787787382.570906:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1787787382.570931:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1787787382.570947:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1787787382.570971:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1787787382.570989:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1787787382.571047:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787382.571652:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.571691:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8191300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.574773:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503739904 00000100:00100000:1.0:1787787382.574790:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503739904 00000100:00100000:1.0:1787787382.574851:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787382.574862:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787382.575061:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503739904:12345-0@lo:502:mount.lustre.0 Request processed in 201us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.575078:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787382.576672:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503739904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787382.576909:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1787787382.576939:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1787787382.576992:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503740032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787382.577057:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.577110:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8191300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787382.577383:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740032 00000100:00100000:0.0:1787787382.577390:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740032 00000100:00100000:0.0:1787787382.577439:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787382.577449:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503740032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787382.577564:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503740032:12345-0@lo:502:mount.lustre.0 Request processed in 117us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.577572:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787382.577743:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503740032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787382.577791:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1787787382.577799:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787787382.582095:0:17901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787787382.582115:0:17901:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9870f57799b8) 00000020:00000080:1.0:1787787382.582314:0:17901:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787787382.582487:0:17901:0:(tgt_mount.c:153:server_get_mount()) get mount ffff987101e33000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787787382.582492:0:17901:0:(tgt_mount.c:187:server_put_mount()) put mount ffff987101e33000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787787382.582494:0:17901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101e33000 3 00010000:00080000:0.0:1787787382.582525:0:17901:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870f576a000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787382.584309:0:17901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787787382.584519:0:17901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787787382.584560:0:17901:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787382.584573:0:17901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x11620bc3f30a9fda 00000100:00080000:0.0:1787787382.584583:0:17901:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787382.584589:0:17901:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9870f576a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787382.584626:0:17901:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4282580 x1874630503740160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787382.587697:0:17901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787787382.587858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787382.587864:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787382.587867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787382.587870:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787787382.588020:0:17901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1787787382.588296:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503740160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787382.588373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787382.590313:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740160 00000100:00100000:0.0:1787787382.590327:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740160 00000100:00100000:0.0:1787787382.590378:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787382.590386:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503740160:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787787382.590414:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1787787382.590452:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x11620bc3f30a9fe1 00000004:00100000:0.0:1787787382.590468:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787787382.590499:0:17152:0:(import.c:65:import_set_state_nolock()) ffff9870f5769800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787382.590583:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874630503740160:12345-0@lo:38:llog_process_th.0 Request processed in 196us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787382.590602:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787787382.590750:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc4282580 x1874630503740160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787382.590762:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787382.590779:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787787382.590787:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787787382.590792:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787787382.590795:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787382.590803:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503740160:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787787382.592708:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787787382.592752:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787787382.592778:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787382.592791:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787787382.592845:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787787382.592847:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787787382.592848:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787382.592849:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787382.592851:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787382.592852:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787382.592853:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787382.592855:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787382.592857:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787382.592860:0:17883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787787382.592862:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787382.592864:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787787382.592865:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787382.592871:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787382.592872:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787382.592873:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787382.592874:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787382.592875:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787382.592876:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787382.592900:0:17883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787787382.592918:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503740288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787787382.592996:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787382.593085:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.596733:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740288 00000100:00100000:1.0:1787787382.596748:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740288 00000100:00100000:2.0:1787787382.599647:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787382.599661:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17883:x1874630503740288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787787382.599695:0:17145:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787787382.599710:0:17145:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787787382.603515:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787787382.603637:0:17145:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787787382.603653:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787787382.603823:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787787382.603829:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787787382.603854:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.603874:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.603882:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.603890:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.603931:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.603948:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 18 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.603976:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503740416:0@lo:104: 00000100:00100000:3.0:1787787382.604050:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787382.604108:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.604127:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 18 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.604167:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503740544:0@lo:104: 00000100:00100000:3.0:1787787382.604189:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787382.604205:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8191600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.604405:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740416 00000100:00100000:1.0:1787787382.604412:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740416 00000100:00100000:1.0:1787787382.604443:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740544 00000100:00100000:1.0:1787787382.604445:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740544 00000100:00100000:1.0:1787787382.604457:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787382.604465:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:17168:x1874630503740416:12345-0@lo:104: 00010000:00010000:1.0:1787787382.604477:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604549:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787382.604555:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:17168:x1874630503740416:12345-0@lo:104: Request processed in 91us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.604562:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787382.604576:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787382.604581:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503740544:12345-0@lo:104: 00010000:00010000:1.0:1787787382.604598:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604629:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787382.604634:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503740544:12345-0@lo:104: Request processed in 53us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.604640:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787787382.604655:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787382.604661:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604668:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787382.604672:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604691:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787382.604698:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787382.604704:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787382.604734:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604741:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787382.604760:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604768:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14200/0x11620bc3f30a9fa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9fb0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604780:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787382.604783:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604788:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787382.604791:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604797:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787382.604803:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787382.604813:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787382.604826:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604832:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787382.604846:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604852:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30a9ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9eec expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.604864:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787382.604865:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787382.604867:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787382.604875:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787382.604894:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503740672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787382.604936:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.604978:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503740800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787382.605000:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.605045:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740672 00000100:00100000:1.0:1787787382.605049:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740672 00010000:00010000:1.0:1787787382.605241:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 19 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787382.605266:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740800 00000100:00100000:1.0:1787787382.605269:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740800 00010000:00010000:1.0:1787787382.605282:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 20 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787382.605306:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787382.605313:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3656:x1874630503740672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787382.605324:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787382.605329:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 20 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605340:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 20 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605355:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787382.605384:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3656:x1874630503740672:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.605391:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787382.605403:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787382.605410:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:3653:x1874630503740800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787382.605417:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787382.605421:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 19 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605430:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 19 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605442:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605450:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787382.605473:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001933789s 00010000:00010000:1.0:1787787382.605478:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605485:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605491:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605496:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605501:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787382.605505:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605513:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605521:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787382.605531:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787382.605558:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:3653:x1874630503740800:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.605565:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787382.605669:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503740800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787382.605695:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503740672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787382.605785:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15800/0x11620bc3f30a9fb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9fa9 expref: 18 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.605797:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503740416:0@lo:104: 00010000:00010000:3.0:1787787382.605807:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30a9eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9ee5 expref: 17 pid: 17147 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787382.605814:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503740544:0@lo:104: 00010000:00010000:3.0:1787787382.605845:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.605854:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.605860:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787382.605867:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f3400/0x11620bc3f30a9fe8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787382.606426:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17883:x1874630503740288:12345-0@lo:253:mount.lustre.0 Request processed in 6766us (13428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.606436:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787382.608340:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:17883:1874630503740288:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787787382.608361:0:17883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787787382.608364:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787382.608366:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787787382.608367:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787382.608369:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787382.608370:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787382.608372:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787382.608373:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787382.608375:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787382.608377:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787787382.608392:0:17883:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1787787382.619361:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787787382.619612:0:17908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787787382.619923:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:3.0:1787787382.620259:0:17907:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787787382.620264:0:17907:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1787787382.620420:0:17908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787382.621770:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874630503740928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.621845:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.621909:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503740928 00000100:00100000:1.0:1787787382.621917:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503740928 00000100:00100000:1.0:1787787382.621972:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787382.621981:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874630503740928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622060:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874630503740928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.622204:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787382.622233:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.622258:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874630503740928:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787787382.622289:0:17909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787787382.622314:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874630503741056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622344:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.622363:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741056 00000100:00100000:1.0:1787787382.622367:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741056 00000100:00100000:1.0:1787787382.622387:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787382.622394:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874630503741056:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622483:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874630503741056:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.622490:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787382.622514:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.622528:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874630503741056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622574:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17909:1874630503741184:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622616:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.622658:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741184 00000100:00100000:1.0:1787787382.622662:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741184 00000100:00100000:1.0:1787787382.622688:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787382.622694:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17909:x1874630503741184:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622727:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17909:x1874630503741184:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.622733:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787382.622749:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faaf00 going to sleep for 11 seconds 00010000:00080000:1.0:1787787382.622765:0:17909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc3f6d00 x1874630503741184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787398 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787382.622774:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17909:1874630503741184:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622805:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874630503741312:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622836:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787382.622852:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741312 00000100:00100000:1.0:1787787382.622855:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741312 00000100:00100000:1.0:1787787382.622872:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787382.622878:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874630503741312:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787787382.622918:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874630503741312:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787382.622923:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787382.622938:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787382.622956:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874630503741312:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787787382.623003:0:17909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787787382.624835:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787787382.624899:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787787382.625341:0:17883:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787787382.625348:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787787382.625388:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787382.626350:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787787382.626873:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787787382.626908:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787787382.627088:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787382.628710:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787787382.628781:0:17908:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1787787382.629888:0:17883:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1787787382.630301:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787787382.630366:0:17909:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787787382.630371:0:17909:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1787787382.632509:0:17883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787787382.652545:0:17883:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787787382.655195:0:17883:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa62241c4f988 00100000:10000000:2.0:1787787382.655211:0:17883:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787787382.658432:0:17883:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787382.658481:0:17883:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787382.658511:0:17883:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787787382.658554:0:17883:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787787382.659889:0:17883:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787382.660131:0:17883:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787787382.761990:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787787382.825262:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787787383.537706:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787383.658559:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787383.850355:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 10000000:01000000:1.0:1787787384.169240:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787384.169249:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff987101e33000 from 8 10000000:01000000:1.0:1787787384.169254:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787384.169315:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787384.169329:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787384.169341:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787384.169370:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787384.169451:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787384.169526:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2ddf900 going to sleep for 11 seconds 00000100:00100000:2.0:1787787384.169667:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741440 00000100:00100000:2.0:1787787384.169675:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741440 00000100:00100000:2.0:1787787384.169738:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787787384.169749:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17149:x1874630503741440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787384.169763:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787384.169778:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9fef expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.169806:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.169818:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.169828:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787384.169879:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503741440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787384.169887:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787384.170718:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787384.170742:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.170754:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787384.170819:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787787384.170858:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787384.170891:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0076600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787384.170981:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741568 00000100:00100000:1.0:1787787384.170988:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741568 00000100:00100000:1.0:1787787384.171030:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787384.171039:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503741568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787384.171058:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787384.171074:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787384.171077:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787787384.173255:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503741568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2207us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787384.173269:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787384.179394:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787384.179566:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787384.179579:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.179590:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787384.179602:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787384.179606:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c5465000 from 8 10000000:01000000:2.0:1787787384.179615:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787384.179651:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.179660:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.179670:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787384.179692:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787384.179754:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787384.179800:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787384.179921:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741696 00000100:00100000:1.0:1787787384.179928:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741696 00000100:00100000:1.0:1787787384.179991:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787384.180001:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503741696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787384.180015:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787384.180028:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30a9ffd expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787384.180052:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 18 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787384.180063:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 18 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787384.180072:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0e00, rc 0) 00000100:00100000:1.0:1787787384.180177:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503741696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787384.180184:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787384.180338:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787384.180350:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.180359:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787384.180412:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787787384.180443:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787384.180471:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0076600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787384.180577:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741824 00000100:00100000:1.0:1787787384.180582:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741824 00000100:00100000:1.0:1787787384.180616:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787384.180623:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503741824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787384.180635:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787384.180651:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787384.180654:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787787384.180727:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503741824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787384.180739:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787787384.180860:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503741824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787787384.180896:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787384.180901:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.180908:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.558277:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787384.682044:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787787384.875192:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787787385.577350:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787385.898497:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787787386.601519:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787386.922089:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 0 seconds 00000001:02000400:1.0:1787787387.479024:0:18152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787787387.625309:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787387.753817:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787787387.753825:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787787387.753830:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787387.753844:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870ff9bd800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787387.753881:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc41721c0 x1874630503742080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787387.753912:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787387.753915:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787387.753918:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787387.753921:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787387.753948:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787387.753952:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787387.753963:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787387.753967:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787387.754234:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503741952:0@lo:400:kworker.0 00000100:00100000:2.0:1787787387.754328:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787387.754389:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787387.754396:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503742464:0@lo:400:kworker.0 00000100:00100000:2.0:1787787387.754427:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787387.754566:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503741952 00000100:00100000:3.0:1787787387.754573:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503741952 00000100:00100000:3.0:1787787387.754627:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787387.754637:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3654:x1874630503741952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787387.754690:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3654:x1874630503741952:12345-0@lo:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.754696:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787387.754727:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742464 00000100:00100000:3.0:1787787387.754731:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742464 00000100:00100000:3.0:1787787387.754754:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787387.754759:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503742464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787387.754786:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503742464:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.754792:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787787387.754822:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc4173c00 x1874630503742464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787387.754836:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503742464:0@lo:400:kworker.0 00000100:00100000:3.0:1787787387.754847:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503741952:0@lo:400:kworker.0 00000100:00100000:1.0:1787787387.754939:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503742208:0@lo:400:kworker.0 00000100:00100000:1.0:1787787387.754969:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787387.754997:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787387.755004:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503742336:0@lo:400:kworker.0 00000100:00100000:1.0:1787787387.755029:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787387.755059:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742336 00000100:00100000:1.0:1787787387.755062:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742336 00000100:00100000:1.0:1787787387.755089:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787387.755095:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503742336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787387.755131:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503742336:12345-0@lo:400:kworker.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.755170:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787387.755211:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503742336:0@lo:400:kworker.0 00000100:00100000:3.0:1787787387.755454:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742208 00000100:00100000:3.0:1787787387.755459:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742208 00000100:00100000:3.0:1787787387.755497:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787387.755504:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503742208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787387.755541:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503742208:12345-0@lo:400:kworker.0 Request processed in 38us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.755559:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787387.755753:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc4172580 x1874630503742208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787387.755764:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503742208:0@lo:400:kworker.0 00000100:00100000:3.0:1787787387.755897:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503742592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787387.755928:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787387.756027:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503742080:0@lo:38:kworker.0 00000100:00100000:0.0:1787787387.756058:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787387.756828:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742592 00000100:00100000:1.0:1787787387.756838:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742592 00000100:00100000:1.0:1787787387.756881:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742080 00000100:00100000:1.0:1787787387.757009:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742080 00000100:00100000:1.0:1787787387.757030:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787387.757039:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503742592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787387.757080:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787787387.757633:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503742592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 593us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.757641:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787387.757662:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787387.757667:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503742080:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787787387.757697:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:1.0:1787787387.757735:0:17157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa00b 00000004:00100000:1.0:1787787387.757756:0:17157:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787787387.757762:0:17157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787787387.757931:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503742592:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787787387.786542:0:17157:0:(import.c:65:import_set_state_nolock()) ffff9870c7f36800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787387.786703:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503742080:12345-0@lo:38:kworker.0 Request processed in 29033us (30642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.786716:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787787387.790126:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787787387.790302:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787787387.790310:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787787387.790314:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787787387.790378:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d0f42cca): req@ffff986fc4283480 x1874630503735168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787387.790404:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503742080:0@lo:38:kworker.0 00000100:00100000:2.0:1787787387.791193:0:17193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787387.791250:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.791651:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503735168 00000100:00100000:1.0:1787787387.791661:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503735168 00000100:00100000:1.0:1787787387.791715:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787387.791724:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1874630503735168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787387.791811:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1874630503735168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.791824:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787387.791925:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1874630503735168:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787787387.791961:0:17193:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787787387.792011:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1874630503742720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787787387.792042:0:17193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787387.792069:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.792233:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742720 00000100:00100000:1.0:1787787387.792237:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742720 00000100:00100000:1.0:1787787387.792255:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787387.792261:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1874630503742720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787387.792357:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1874630503742720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.792363:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787787387.792629:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1874630503742720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787787387.792710:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1874630503742848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787787387.792737:0:17193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787387.792749:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.792799:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742848 00000100:00100000:1.0:1787787387.792803:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742848 00000100:00100000:1.0:1787787387.792819:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787387.792824:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1874630503742848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787387.792898:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1874630503742848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.792904:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787387.793117:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1874630503742848:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787787387.793182:0:17193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787387.800304:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787387.800331:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503742976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787387.800414:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787387.800468:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503742976 00000100:00100000:0.0:1787787387.800476:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503742976 00000100:00100000:0.0:1787787387.800524:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787387.800533:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503742976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787387.800567:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787387.800614:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503742976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787387.800622:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787387.800668:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503742976:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787787387.800819:0:17193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787787387.800900:0:17193:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:2.0:1787787387.800905:0:17193:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1787787388.413111:0:18204:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787388.413722:0:18204:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787388.652323:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787389.429296:0:18254:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787389.429511:0:18254:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787389.673348:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787390.547979:0:18303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe205b7ad0 20000000:00000080:0.0:1787787390.547996:0:18303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9870c4b90400 uarg=0000000000000000 20000000:01000000:0.0:1787787390.548037:0:18303:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787787390.548045:0:18303:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787787390.548049:0:18303:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787787390.548779:0:18304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787787390.548954:0:18303:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787787390.555133:0:18303:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787787390.555196:0:18303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.555216:0:18303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.555224:0:18303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.555251:0:18303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.555291:0:18303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.555305:0:18303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 17 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.555319:0:18303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874630503743104:0@lo:104: 00000100:00100000:0.0:1787787390.555481:0:18303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787390.555559:0:18303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.555568:0:18303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.555577:0:18303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42812c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874630503743232:0@lo:104: 00000100:00100000:0.0:1787787390.555595:0:18303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787390.556089:0:18303:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787390.556347:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743104 00000100:00100000:1.0:1787787390.556354:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743104 00000100:00100000:1.0:1787787390.556458:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743232 00000100:00100000:1.0:1787787390.556462:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743232 00000100:00100000:1.0:1787787390.556479:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787390.556487:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:18303:x1874630503743104:12345-0@lo:104: 00010000:00010000:1.0:1787787390.556500:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.556571:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787390.556578:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:18303:x1874630503743104:12345-0@lo:104: Request processed in 92us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.556594:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787390.556610:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787390.556616:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:18303:x1874630503743232:12345-0@lo:104: 00010000:00010000:1.0:1787787390.556624:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.556754:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787390.556760:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:18303:x1874630503743232:12345-0@lo:104: Request processed in 144us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.556767:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787390.556834:0:18303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874630503743104:0@lo:104: 00000100:00100000:0.0:1787787390.556843:0:18303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42812c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874630503743232:0@lo:104: 00010000:00010000:0.0:1787787390.556870:0:18303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557028:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787390.557036:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557044:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787390.557048:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557057:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787390.557065:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787390.557070:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787390.557133:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557177:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787390.557198:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557205:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15200/0x11620bc3f30a9fb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9fbe expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557217:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787390.557220:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557225:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787390.557228:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.557235:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787390.557241:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787390.557247:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787787390.557287:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503743360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787390.557319:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787390.557463:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787390.557496:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743360 00000100:00100000:1.0:1787787390.557500:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743360 00010000:00010000:1.0:1787787390.557519:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 18 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.557539:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787390.557546:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3656:x1874630503743360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787390.557569:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787390.557575:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 18 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.557585:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 18 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.557600:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3800/0x11620bc3f30a9fbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9fb7 expref: 18 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.557619:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787390.557665:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:3656:x1874630503743360:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.557681:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787390.557711:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503743360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787390.558028:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.558036:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787390.558059:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.558066:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30a9eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ebb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.558086:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787390.558087:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787390.558089:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787390.558120:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787390.558129:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503743488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787390.558294:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787390.558319:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743488 00000100:00100000:0.0:1787787390.558324:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743488 00010000:00010000:0.0:1787787390.558339:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.558359:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787390.558377:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:3654:x1874630503743488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787390.558386:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787390.558391:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558400:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558410:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f3200/0x11620bc3f30a9ebb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9eb4 expref: 17 pid: 17146 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558420:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558429:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558443:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558450:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558469:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558475:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558479:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787390.558484:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558492:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558506:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558515:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787390.558543:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:3654:x1874630503743488:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.558549:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787390.558575:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503743488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787390.558596:0:18303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558602:0:18303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.558608:0:18303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14600/0x11620bc3f30aa012 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.697301:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787391.722923:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787787391.723077:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787391.723082:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff987101e33000 from 13 10000000:01000000:3.0:1787787391.723087:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787391.723254:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787391.723266:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787391.723277:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787391.723304:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503743616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787391.723372:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787391.723406:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cb1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787391.723495:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743616 00000100:00100000:1.0:1787787391.723503:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743616 00000100:00100000:1.0:1787787391.723565:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787391.723574:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+16:17149:x1874630503743616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787391.723589:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787391.723604:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa019 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.723627:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.723638:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.723648:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1600, rc 0) 00000100:00100000:1.0:1787787391.723700:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503743616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.723706:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787391.724358:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503743616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787391.724375:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787391.724385:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787391.724451:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503743744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787391.724486:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787391.724517:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d841d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787391.724601:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743744 00000100:00100000:1.0:1787787391.724606:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743744 00000100:00100000:1.0:1787787391.724652:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787391.724659:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503743744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.724778:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503743744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.724796:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787391.724827:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503743744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.724855:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503743872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.724894:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787391.724908:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787391.724929:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503743872 00000100:00100000:1.0:1787787391.724932:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503743872 00000100:00100000:1.0:1787787391.724948:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787787391.724953:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503743872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.725026:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503743872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.725033:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787787391.725083:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503743872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787391.725733:0:18360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787787391.725803:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787787391.725826:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787391.725836:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.725846:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787391.725869:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787391.725872:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c5465000 from 13 10000000:01000000:1.0:1787787391.725874:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787391.725899:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.725907:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.725917:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787391.725934:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503744000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.725971:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787391.725996:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787391.726010:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744000 00000100:00100000:1.0:1787787391.726014:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744000 00000100:00100000:1.0:1787787391.726035:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787787391.726041:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+17:17149:x1874630503744000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787391.726050:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787391.726060:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa027 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.726079:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.726089:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.726110:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0c00, rc 0) 00000100:00100000:1.0:1787787391.726168:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503744000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.726174:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787787391.726207:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503744000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787391.726219:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.726227:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787391.726265:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503744128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.726287:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787391.726305:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787391.726316:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744128 00000100:00100000:1.0:1787787391.726318:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744128 00000100:00100000:1.0:1787787391.726334:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787787391.726339:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503744128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.726413:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503744128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.726419:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787787391.726442:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503744128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.726465:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503744256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.726498:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787391.726516:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787391.726526:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744256 00000100:00100000:1.0:1787787391.726529:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744256 00000100:00100000:1.0:1787787391.726544:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787391.726550:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503744256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787391.726613:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:17149:x1874630503744256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.726620:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787391.726655:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503744256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787391.727338:0:18361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787787391.727388:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787787391.727401:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787391.727408:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.727416:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.746071:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787392.878196:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787382/real 1787787382] req@ffff986fc4281680 x1874630503738368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787392 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787392.878230:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4281680 x1874630503738368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787392 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787392.878241:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787382/real 1787787382] req@ffff986fc4282d00 x1874630503738240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787392 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787392.878253:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4282d00 x1874630503738240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787392 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787787392.878281:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787392.878294:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787787392.878298:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503738368:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787787392.878304:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787392.878310:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787787392.878313:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503738240:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787787392.879338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787392.879344:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787392.879346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787392.879349:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787392.879363:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787392.879366:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787787392.879369:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787392.879376:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1787787392.879381:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787787392.879386:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9870f3637800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787392.879406:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4283c00 x1874630503744896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787392.879421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787392.879424:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787787392.879426:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787392.879429:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1787787392.879432:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787787392.879435:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870f576d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787392.879446:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4283480 x1874630503745024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787392.879478:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503744384:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.879543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787392.879592:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503745152:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.879622:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787392.879647:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787392.879652:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503744768:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.879678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787392.879707:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503744512:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.879730:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787392.879746:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787392.879751:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503744640:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.879788:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787392.879817:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503744896:0@lo:8:kworker.0 00000400:00000100:0.0:1787787392.879839:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503744896 offset 0 length 520: 4 00000100:00100000:0.0:1787787392.879851:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503745024:0@lo:8:kworker.0 00000400:00000100:0.0:1787787392.879868:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503745024 offset 0 length 520: 4 00000100:00100000:0.0:1787787392.879894:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744384 00000100:00100000:0.0:1787787392.879901:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744384 00000100:00100000:0.0:1787787392.879946:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787392.879955:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3654:x1874630503744384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880000:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3654:x1874630503744384:12345-0@lo:400:kworker.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787392.880007:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787392.880037:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503745152 00000100:00100000:0.0:1787787392.880040:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503745152 00000100:00100000:0.0:1787787392.880065:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744640 00000100:00100000:0.0:1787787392.880069:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744640 00000100:00100000:0.0:1787787392.880084:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787392.880098:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503745152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880130:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503745152:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787392.880162:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787392.880177:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787392.880182:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503744640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880215:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503744640:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787392.880221:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787392.880237:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744768 00000100:00100000:0.0:1787787392.880241:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744768 00000100:00100000:0.0:1787787392.880256:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503744512 00000100:00100000:0.0:1787787392.880258:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503744512 00000100:00100000:0.0:1787787392.880271:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787392.880276:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503744768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880307:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503744768:12345-0@lo:400:kworker.0 Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787392.880313:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787392.880324:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787392.880330:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503744512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880356:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503744512:12345-0@lo:400:kworker.0 Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787392.880362:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787392.880406:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503744768:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880416:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503744384:0@lo:400:kworker.0 00010000:00080000:0.0:1787787392.880437:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc42821c0 x1874630503745152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787392.880447:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503745152:0@lo:400:kworker.0 00010000:00080000:0.0:1787787392.880481:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc4282d00 x1874630503744640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787392.880491:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503744640:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.880500:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503744512:0@lo:400:kworker.0 00000100:00100000:0.0:1787787392.884750:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503745408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787392.884836:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787392.884877:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787392.884884:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503745280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787392.884907:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787392.885004:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503745408 00000100:00100000:1.0:1787787392.885014:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503745408 00000100:00100000:1.0:1787787392.885051:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503745280 00000100:00100000:1.0:1787787392.885054:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503745280 00000100:00100000:1.0:1787787392.885070:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787392.885078:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503745408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787392.885111:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787787392.885197:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503745408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787392.885204:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787392.885220:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787392.885226:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503745280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787392.885243:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787392.885273:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503745280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787392.885279:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787392.885543:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503745280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787392.885557:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503745408:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787787393.004705:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787393.769321:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787393.899649:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787787394.793848:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787394.926100:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787787395.819185:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787395.947739:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787380/real 1787787380] req@ffff9870fc3f7c00 x1874630503736192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787395 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787395.947786:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9870fc3f7c00 x1874630503736192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787395 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787395.947796:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787380/real 1787787380] req@ffff9870fc3f4780 x1874630503736320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787395 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787395.947808:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9870fc3f4780 x1874630503736320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787395 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787395.947837:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787395.947847:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787787395.947851:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503736192:0@lo:8:kworker.0 00000100:00080000:0.0:1787787395.947856:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787395.947862:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787787395.947866:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503736320:0@lo:8:kworker.0 00000100:00080000:3.0:1787787395.949177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787787395.949177:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1787787395.949182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787787395.949196:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787787395.949196:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503745664:0@lo:400:kworker.0 00000100:00080000:3.0:1787787395.949201:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787787395.949634:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787395.949642:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9870c3ecd000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787395.949667:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4172d00 x1874630503745792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787395.949697:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787395.949700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787787395.949702:0:8:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787395.949717:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787787395.949720:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787395.949725:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff987101e37800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787395.949737:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4170000 x1874630503745920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787395.949953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787395.949957:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787395.949960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787395.949963:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787395.949991:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503746304:0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.950326:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503746048:0@lo:400:kworker.0 00000100:00100000:3.0:1787787395.950404:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787395.950404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.950683:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.950724:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787395.950731:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503746176:0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.950754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.950796:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503745664 00000100:00100000:1.0:1787787395.950804:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503745664 00000100:00100000:1.0:1787787395.950841:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746176 00000100:00100000:1.0:1787787395.950844:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746176 00000100:00100000:1.0:1787787395.950859:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787395.950866:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503745664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.950907:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503745664:12345-0@lo:400:kworker.0 Request processed in 42us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787395.950913:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787395.950927:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787395.950931:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503746176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.950959:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503746176:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787395.950965:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787395.950979:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746304 00000100:00100000:1.0:1787787395.950982:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746304 00000100:00100000:1.0:1787787395.951002:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746048 00000100:00100000:1.0:1787787395.951005:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746048 00000100:00100000:1.0:1787787395.951019:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787395.951026:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503746304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.951058:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503746304:12345-0@lo:400:kworker.0 Request processed in 33us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787395.951061:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503745664:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.951072:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503745536:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.951105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787395.951239:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503745536 00000100:00100000:2.0:1787787395.951245:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503745536 00010000:00080000:3.0:1787787395.951302:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc41721c0 x1874630503746304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787395.951313:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503746304:0@lo:400:kworker.0 00000100:00100000:3.0:1787787395.951341:0:17153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787787395.951349:0:17153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787787395.951353:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787787395.951374:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3654:x1874630503745536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.951419:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:3654:x1874630503745536:12345-0@lo:400:kworker.0 Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787395.951426:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787787395.951461:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503745792:0@lo:8:kworker.0 00000100:00100000:2.0:1787787395.951475:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503745536:0@lo:400:kworker.0 00000400:00000100:3.0:1787787395.951496:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503745792 offset 0 length 520: 4 00000100:00100000:3.0:1787787395.951522:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503745920:0@lo:8:kworker.0 00000400:00000100:3.0:1787787395.951551:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503745920 offset 0 length 520: 4 00000100:00100000:2.0:1787787395.951620:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787395.951629:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503746048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.951661:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503746048:12345-0@lo:400:kworker.0 Request processed in 34us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787395.951667:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787395.952573:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787395.952627:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503746176:0@lo:400:kworker.0 00010000:00080000:1.0:1787787395.952642:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc4170f00 x1874630503746048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787395.952652:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503746048:0@lo:400:kworker.0 00010000:00010000:1.0:1787787396.841640:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787397.412668:0:18652:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787397.412672:0:18652:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787787397.412673:0:18652:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787787397.412880:0:18652:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870fc38d000 00000020:01000004:3.0:1787787397.412969:0:18652:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787787397.412985:0:18652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787787397.413000:0:18652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9870d22f0000) 00000020:00000080:3.0:1787787397.413017:0:18652:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787787397.458992:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787787397.462563:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787787397.463022:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787787397.463418:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787787397.463613:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787787397.463885:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787787397.464168:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787787397.465208:0:18652:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787787397.465630:0:18652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787787397.465643:0:18652:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787787397.465999:0:18652:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x11620bc3f30aa03c 00000020:01000004:1.0:1787787397.466009:0:18652:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787787397.466034:0:18652:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787787397.466038:0:18652:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787787397.466045:0:18652:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787787397.466050:0:18652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787787397.466061:0:18652:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9870f5778000) 00000020:00000080:1.0:1787787397.466072:0:18652:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1787787397.467688:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787397.467862:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787397.467869:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787787397.473823:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787787397.473838:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787787397.474446:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787787397.474454:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787787397.476610:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787397.476884:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787787397.476890:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787787397.478019:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787787397.478030:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787787397.500043:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787397.500518:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787787397.500525:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787787397.502619:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787397.502634:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787787397.503838:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787397.503848:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787787397.506860:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787397.507122:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787787397.507128:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787787397.507960:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787787397.507967:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787787397.563685:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787397.563919:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787787397.563926:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787787397.566337:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787787397.566426:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787787397.567068:0:18652:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787787397.567108:0:18652:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787787397.567115:0:18652:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787787397.597629:0:18652:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787397.597697:0:18652:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.131@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787787397.597702:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787397.597704:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787397.597706:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787397.597707:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787397.597709:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787397.597710:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787397.597712:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787397.597714:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787397.597715:0:18652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787397.597718:0:18652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787787397.597720:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787397.597721:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787397.597722:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787397.597723:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787397.597734:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787397.597735:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787397.597742:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787397.597743:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787397.597744:0:18652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787397.597771:0:18652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787787397.597793:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787397.597867:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.597917:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.598128:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746432 00000100:00100000:0.0:1787787397.598176:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746432 00000100:00100000:0.0:1787787397.598259:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787397.598270:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:18652:x1874630503746432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787397.598317:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787787397.598320:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787787397.598324:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787787397.598838:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:18652:x1874630503746432:12345-0@lo:253:mount.lustre.0 Request processed in 569us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.598853:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787787397.599049:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787787397.599061:0:18652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787787397.599063:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787397.599064:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787397.599065:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787397.599066:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787397.599067:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787397.599068:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787397.599070:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787397.599071:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787397.599073:0:18652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787787397.599092:0:18652:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870fc38d000 from lustre-OST0000 10000000:01000000:3.0:1787787397.599118:0:18652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787787397.599120:0:18652:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787787397.599128:0:18652:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9870fc36b370 local copy 00010000:00010000:3.0:1787787397.599161:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.599393:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787397.599433:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.599468:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787397.600667:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746560 00000100:00100000:2.0:1787787397.600690:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746560 00000100:00100000:2.0:1787787397.600762:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787787397.600772:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:18652:x1874630503746560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787397.600905:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:18652:x1874630503746560:12345-0@lo:501:mount.lustre.0 Request processed in 135us (1471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787397.600914:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787787397.601455:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746560:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787787397.601478:0:18652:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787787397.601507:0:18652:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787787397.601529:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.601540:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787397.601572:0:18652:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870fc38d000 10000000:01000000:3.0:1787787397.601577:0:18652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787787397.601583:0:18652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787787397.601586:0:18652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787397.601591:0:18652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787787397.601594:0:18652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787787397.601852:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.601862:0:18652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.601872:0:18652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.601892:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787397.601939:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.602017:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.607385:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746688 00000100:00100000:0.0:1787787397.607399:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746688 00000100:00100000:0.0:1787787397.607460:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787787397.607471:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+18:18652:x1874630503746688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787397.607487:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787397.607507:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14200/0x11620bc3f30aa051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa04a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787397.607539:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14200/0x11620bc3f30aa051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa04a expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787397.607551:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14200/0x11620bc3f30aa051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa04a expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787397.607560:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14200, rc 0) 00000100:00100000:0.0:1787787397.607653:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503746688:12345-0@lo:101:mount.lustre.0 Request processed in 184us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.607661:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787397.607879:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787397.607899:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.607909:0:18652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787397.611178:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787787397.612003:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787397.617646:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787787397.618165:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787787397.618197:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787787397.618214:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787787397.618228:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787787397.618242:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787787397.618351:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787787397.618358:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787787397.618466:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787397.618537:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.618584:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787397.618593:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746816 00000100:00100000:2.0:1787787397.618602:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746816 00000100:00100000:2.0:1787787397.618683:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787787397.618693:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503746816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787397.618842:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503746816:12345-0@lo:501:mount.lustre.0 Request processed in 150us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.618850:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787397.618903:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787397.618934:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787397.618975:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.618998:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787397.619214:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503746944 00000100:00100000:2.0:1787787397.619219:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503746944 00000100:00100000:2.0:1787787397.619251:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787397.619257:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503746944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787397.620964:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503746944:12345-0@lo:503:mount.lustre.0 Request processed in 1699us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.620976:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787787397.621080:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503746944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787397.621571:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787397.621647:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787397.621707:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.621747:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.622180:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747072 00000100:00100000:0.0:1787787397.622187:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747072 00000100:00100000:0.0:1787787397.622229:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787397.622237:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503747072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787397.622697:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503747072:12345-0@lo:502:mount.lustre.0 Request processed in 459us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.622706:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787787397.622808:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787397.623075:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787787397.623107:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787787397.623135:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787787397.623371:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787787397.623387:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787787397.623493:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787787397.623526:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787787397.623540:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787787397.623552:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787787397.623565:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787787397.623578:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787787397.623591:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787787397.624418:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787397.624499:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.624599:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787397.627368:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747200 00000100:00100000:2.0:1787787397.627386:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747200 00000100:00100000:0.0:1787787397.631957:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787397.631986:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503747200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787397.632196:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503747200:12345-0@lo:502:mount.lustre.0 Request processed in 212us (7696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.632204:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787787397.632249:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787397.632373:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787787397.632387:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787787397.634237:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787397.634249:0:18669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787787397.634256:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787397.634259:0:18669:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787787397.634265:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787397.634293:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9870f577cd28) 00000020:00000080:1.0:1787787397.634316:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787787397.634322:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787787397.634412:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc38d000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787787397.634421:0:18669:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787787397.634435:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x11620bc3f30aa05f 00010000:00010000:1.0:1787787397.645016:0:18669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787787397.645649:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787787397.647969:0:18669:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787787397.654222:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787787397.654236:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787397.655796:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787397.655805:0:18669:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787787397.655817:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787787397.655821:0:18669:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1787787397.655822:0:18669:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787397.655824:0:18669:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787397.655826:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787787397.655830:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787397.655831:0:18669:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787787397.655834:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787397.655837:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787397.655839:0:18669:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787397.655842:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787397.655844:0:18669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787787397.655847:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787397.655850:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787397.655851:0:18669:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787787397.655853:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787397.655862:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787397.655863:0:18669:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787787397.655867:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787787397.655893:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787397.655896:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787397.655897:0:18669:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787787397.655900:0:18669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787787397.656088:0:18652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787787397.656115:0:18652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787787397.656162:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.656179:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787397.656188:0:18652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc38d000 from 1 10000000:01000000:1.0:1787787397.656190:0:18652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787397.656230:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.656238:0:18652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.656268:0:18652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787397.656293:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787397.656360:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787397.656394:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787397.658222:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747328 00000100:00100000:1.0:1787787397.658234:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747328 00000100:00100000:1.0:1787787397.658296:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787787397.658305:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:18652:x1874630503747328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787397.658319:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787397.658334:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa066 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.658360:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.658370:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.658379:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1a00, rc 0) 00000100:00100000:1.0:1787787397.658451:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747328:12345-0@lo:101:mount.lustre.0 Request processed in 145us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787397.658458:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787787397.658514:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787397.658530:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.658550:0:18652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787397.663444:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787787397.663747:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787397.663934:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787787397.663959:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787787397.663975:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787787397.663979:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787787397.664048:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787397.664120:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787397.664388:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.668681:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747456 00000100:00100000:0.0:1787787397.668696:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747456 00000100:00100000:0.0:1787787397.668756:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787397.668766:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787397.668927:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747456:12345-0@lo:501:mount.lustre.0 Request processed in 162us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.668934:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787787397.669380:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787397.669593:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787397.669645:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787397.669691:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.670444:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747584 00000100:00100000:0.0:1787787397.670452:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747584 00000100:00100000:0.0:1787787397.670497:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787787397.670507:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787397.670619:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747584:12345-0@lo:503:mount.lustre.0 Request processed in 113us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.670627:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787397.670769:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787787397.671207:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787397.671290:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787397.671336:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787397.671366:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.671628:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747712 00000100:00100000:0.0:1787787397.671633:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747712 00000100:00100000:0.0:1787787397.671684:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787397.671693:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787397.671787:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747712:12345-0@lo:502:mount.lustre.0 Request processed in 95us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.671794:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787397.671843:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787397.672061:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787787397.672086:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787787397.672099:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787787397.672112:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787787397.672125:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787787397.672161:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787787397.672178:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787787397.672193:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787787397.672206:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787787397.672217:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787787397.672228:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787787397.675380:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787397.675575:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.675620:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2be4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787397.675917:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747840 00000100:00100000:1.0:1787787397.675925:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747840 00000100:00100000:1.0:1787787397.675979:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787397.675988:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787397.676161:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747840:12345-0@lo:502:mount.lustre.0 Request processed in 149us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787397.676170:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787787397.676286:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787397.676374:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787787397.676388:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787787397.678806:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787397.678818:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678821:0:18673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787787397.678828:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870fc38d000 00000020:00000080:0.0:1787787397.678831:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787397.678838:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787397.678840:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678842:0:18673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787787397.678844:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787397.678846:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678847:0:18673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787787397.678849:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870fc38d000 00000020:00000080:0.0:1787787397.678851:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787397.678914:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787397.678918:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678919:0:18673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787787397.678922:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787397.678924:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678931:0:18673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787397.678935:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870fc38d000 00000020:00000080:0.0:1787787397.678937:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787397.678957:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787397.678960:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678961:0:18673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787397.678963:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787397.678966:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.678967:0:18673:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787787397.678970:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870fc38d000 00000020:00000080:0.0:1787787397.678972:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787397.678995:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787397.678998:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787397.679000:0:18673:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787787397.679003:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787787397.688627:0:18652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787787397.688687:0:18652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787397.688711:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.688723:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787397.688788:0:18652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787787397.688792:0:18652:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870fc38d000 10000000:01000000:3.0:1787787397.688795:0:18652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870fc38d000 10000000:01000000:3.0:1787787397.688799:0:18652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787397.688805:0:18652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870fc38d000 from 1 10000000:01000000:3.0:1787787397.688807:0:18652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787397.688843:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.688852:0:18652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.688863:0:18652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.688889:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787397.688956:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.689008:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787397.689075:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503747968 00000100:00100000:1.0:1787787397.689083:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503747968 00000100:00100000:1.0:1787787397.689129:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787397.689166:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:18652:x1874630503747968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787397.689179:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787397.689192:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1800/0x11620bc3f30aa07b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa074 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.689215:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1800/0x11620bc3f30aa07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa074 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.689225:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1800/0x11620bc3f30aa07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa074 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787397.689233:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1800, rc 0) 00000100:00100000:1.0:1787787397.689286:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503747968:12345-0@lo:101:mount.lustre.0 Request processed in 148us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787397.689293:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787787397.689853:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503747968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787397.689869:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.689878:0:18652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787397.707722:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787787397.708044:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787397.708423:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787787397.708449:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787787397.708462:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787787397.708476:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787787397.708490:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787787397.708503:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787787397.708516:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787787397.708529:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787787397.708542:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787787397.708554:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787787397.708576:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787787397.708589:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787787397.708601:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787787397.708613:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787787397.708625:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787787397.708658:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787787397.708687:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787787397.708703:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787787397.708715:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787787397.708727:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787787397.708740:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787787397.708755:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787787397.708768:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787787397.708782:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787787397.708794:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787787397.708805:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787787397.708816:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787787397.708828:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787787397.708842:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787787397.708855:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787787397.708867:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787787397.708894:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787787397.708910:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787787397.708923:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787787397.708936:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787787397.708949:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787787397.708961:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787787397.708980:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787787397.708985:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787787397.709078:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787397.714868:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787397.714927:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787397.717531:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748096 00000100:00100000:1.0:1787787397.717546:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748096 00000100:00100000:1.0:1787787397.717677:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787397.717692:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787397.717882:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748096:12345-0@lo:501:mount.lustre.0 Request processed in 194us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787397.717904:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787787397.721438:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787397.721505:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787397.721581:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.721623:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787397.721732:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748224 00000100:00100000:1.0:1787787397.721739:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748224 00000100:00100000:1.0:1787787397.721800:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787397.721811:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787397.721937:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748224:12345-0@lo:503:mount.lustre.0 Request processed in 127us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787397.721945:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787787397.722025:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748224:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787397.722497:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787397.722571:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787397.722617:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.722649:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787397.722707:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748352 00000100:00100000:0.0:1787787397.722713:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748352 00000100:00100000:0.0:1787787397.722749:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787787397.722758:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787397.722867:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748352:12345-0@lo:502:mount.lustre.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.722874:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787397.722917:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41703c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787397.723085:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787787397.723111:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787787397.723125:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787787397.723169:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787787397.723188:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787787397.723202:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787787397.723216:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787787397.723229:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787787397.726581:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787787397.726638:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787787397.726688:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787787397.726706:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787787397.726720:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787787397.726734:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787787397.726748:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787787397.726762:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787787397.726776:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787787397.726789:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787787397.726803:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787787397.726818:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787787397.726843:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787787397.726858:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787787397.726872:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787787397.726886:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787787397.726898:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787787397.726912:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787787397.726939:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787787397.726957:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787787397.726974:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787787397.726989:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787787397.727004:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787787397.727018:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787787397.727033:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787787397.727046:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787787397.727059:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787787397.727071:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787787397.727083:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787787397.727094:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787787397.727107:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787787397.727119:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787787397.727131:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787787397.727173:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787787397.727203:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787787397.727219:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787787397.727232:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787787397.729444:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787787397.729511:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787787397.729530:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787787397.729597:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787397.729701:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787397.729752:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787397.730420:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748480 00000100:00100000:2.0:1787787397.730428:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748480 00000100:00100000:2.0:1787787397.730482:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787787397.730492:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787397.733926:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748480:12345-0@lo:502:mount.lustre.0 Request processed in 3423us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.733943:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787787397.737326:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787397.737794:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787787397.737835:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787787397.737878:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787397.737956:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787397.738011:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2bb1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787397.738068:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748608 00000100:00100000:2.0:1787787397.738075:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748608 00000100:00100000:2.0:1787787397.738127:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787787397.738161:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787397.738281:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503748608:12345-0@lo:502:mount.lustre.0 Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.738289:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787787397.742443:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503748608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787397.742555:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1787787397.742569:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787787397.743822:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787787397.743838:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff987101db4d28) 00000020:00000080:2.0:1787787397.743860:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787787397.743934:0:18678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc38d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787397.743938:0:18678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc38d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787397.743940:0:18678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc38d000 3 00010000:00080000:2.0:1787787397.743968:0:18678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc4152000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787397.750045:0:18678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787787397.752071:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787787397.752130:0:18678:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787397.752159:0:18678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x11620bc3f30aa089 00000100:00080000:0.0:1787787397.752171:0:18678:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787397.752177:0:18678:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc4152000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787397.752212:0:18678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc2e7c00 x1874630503748736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787397.754435:0:18678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787787397.754505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787397.754509:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787397.754512:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787397.754515:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787397.754540:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787397.754543:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787397.754545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787397.754548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787787397.754586:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503748864:0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.754657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.754704:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787397.754710:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503749248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.754735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.754797:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503749120:0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.754826:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.754845:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787397.754850:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503748992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.754870:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.754896:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749248 00000100:00100000:0.0:1787787397.754903:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749248 00000100:00100000:0.0:1787787397.754942:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748992 00000100:00100000:0.0:1787787397.754946:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748992 00000100:00100000:0.0:1787787397.754984:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787397.754993:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503749248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.755044:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503749248:12345-0@lo:400:kworker.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.755051:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787397.755067:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787397.755073:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503748992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.755101:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503748992:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.755107:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787397.755125:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748864 00000100:00100000:0.0:1787787397.755128:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748864 00000100:00100000:0.0:1787787397.755167:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749120 00000100:00100000:0.0:1787787397.755170:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749120 00000100:00100000:0.0:1787787397.755183:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787397.755189:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503748864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.755220:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503748864:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.755226:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787397.755236:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787397.755241:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503749120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.755279:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503749120:12345-0@lo:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.755284:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787787397.755316:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc2e6580 x1874630503748992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787397.755341:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503748992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.755353:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503749120:0@lo:400:kworker.0 00010000:00080000:0.0:1787787397.755381:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc2e4780 x1874630503749248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787397.755389:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503749248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787397.755397:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503748864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787397.758720:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503748736:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787397.758813:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.759079:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503748736 00000100:00100000:0.0:1787787397.759088:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503748736 00000100:00100000:0.0:1787787397.761866:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787397.761878:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503748736:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787787397.761910:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1787787397.761948:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x11620bc3f30aa090 00000004:00100000:0.0:1787787397.761966:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787787397.762002:0:17153:0:(import.c:65:import_set_state_nolock()) ffff986fc2409000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787397.762522:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874630503748736:12345-0@lo:38:llog_process_th.0 Request processed in 642us (3708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.762531:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1787787397.767768:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787787397.767786:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9870f4588000) 00000020:00000080:0.0:1787787397.767809:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787787397.767914:0:18678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc38d000 from lustre-OST0000, refs=3 00010000:00080000:3.0:1787787397.768358:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc2e7c00 x1874630503748736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787397.768370:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787397.768382:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787787397.768397:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787787397.768402:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787787397.768406:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc4152000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787397.768413:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503748736:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787787397.768843:0:18678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc38d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787787397.768848:0:18678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc38d000 3 00010000:00080000:0.0:1787787397.768881:0:18678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc240a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787397.772911:0:18678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787787397.773419:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787787397.773462:0:18678:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787397.773475:0:18678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x11620bc3f30aa09e 00000100:00080000:0.0:1787787397.773484:0:18678:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787397.773490:0:18678:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff986fc240a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787397.773521:0:18678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870fc2e5e00 x1874630503749376/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787397.773549:0:18678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787787397.773616:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503749376:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787397.773698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.773766:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749376 00000100:00100000:3.0:1787787397.773773:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749376 00000100:00100000:3.0:1787787397.773801:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787397.773808:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503749376:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787787397.773829:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1787787397.773869:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x11620bc3f30aa0a5 00000004:00100000:3.0:1787787397.773883:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787397.773909:0:17154:0:(import.c:65:import_set_state_nolock()) ffff986fc4869800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787397.773969:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874630503749376:12345-0@lo:38:llog_process_th.0 Request processed in 161us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787397.773977:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787787397.774014:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870fc2e5e00 x1874630503749376/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787397.774025:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787397.774032:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787787397.774039:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787787397.774043:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787787397.774045:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc240a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787397.774049:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503749376:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787787397.776576:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787787397.776638:0:18652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787787397.776676:0:18652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787397.776692:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787397.776703:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787397.776759:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787397.776761:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787397.776762:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787397.776763:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787397.776764:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787397.776766:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787397.776767:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787397.776769:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787397.776770:0:18652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787397.776774:0:18652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787787397.776776:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787397.776778:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787397.776779:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787397.776780:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787397.776786:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787397.776787:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787397.776788:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787397.776789:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787397.776790:0:18652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787397.776819:0:18652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787787397.776838:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503749504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787397.776908:0:18652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787397.776962:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749504 00000100:00100000:0.0:1787787397.776969:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749504 00000100:00100000:0.0:1787787397.777012:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787787397.777021:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503749504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787397.777047:0:17145:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787787397.777059:0:17145:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787787397.777216:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3761f00 going to sleep for 11 seconds 00000100:00080000:2.0:1787787397.779898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787397.779906:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787397.779908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787397.779918:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787397.779995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787397.779998:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787397.780001:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787397.780004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:0.0:1787787397.784632:0:17145:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787787397.784653:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787787397.784998:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:18652:x1874630503749504:12345-0@lo:253:mount.lustre.0 Request processed in 7973us (8085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787397.785010:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787787397.785041:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:18652:1874630503749504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787787397.785056:0:18652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787787397.785059:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787397.785061:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787397.785062:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787397.785064:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787397.785065:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787397.785066:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787397.785068:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787397.785070:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787397.785071:0:18652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787787397.785086:0:18652:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787787397.785160:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787787397.785166:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787787397.785185:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785202:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785209:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785216:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785263:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785278:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 20 pid: 17146 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.785292:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503749632:0@lo:104: 00000100:00100000:3.0:1787787397.785330:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787397.785374:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785384:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 20 pid: 17147 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.785405:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503749760:0@lo:104: 00000100:00100000:3.0:1787787397.785429:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.785462:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787397.785484:0:17135:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787787397.785497:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749632 00000100:00100000:3.0:1787787397.785504:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749632 00000100:00100000:3.0:1787787397.785533:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749760 00000100:00100000:3.0:1787787397.785536:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749760 00000100:00100000:3.0:1787787397.785548:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787397.785556:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:17168:x1874630503749632:12345-0@lo:104: 00010000:00010000:3.0:1787787397.785569:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785623:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787397.785629:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:17168:x1874630503749632:12345-0@lo:104: Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787397.785635:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787397.785648:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787397.785654:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f4254050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503749760:12345-0@lo:104: 00000100:00100000:2.0:1787787397.785656:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503749632:0@lo:104: 00010000:00010000:3.0:1787787397.785662:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785716:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787787397.785731:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f4254050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503749760:12345-0@lo:104: Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787397.785737:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787397.785739:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503749760:0@lo:104: 00010000:00010000:2.0:1787787397.785754:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785877:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787397.785884:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785893:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787397.785903:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.785913:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787397.786364:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787397.786371:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787397.786443:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.786449:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787397.786470:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.786477:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2800/0x11620bc3f30a9ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa004 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.786488:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787397.786491:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.786497:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787397.786500:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.786507:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787397.786523:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787397.786528:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787397.787062:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.787072:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787397.787097:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.787105:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e0000/0x11620bc3f30a9fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30a9ff6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787397.787120:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787397.787123:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787397.787124:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787397.787131:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787397.787164:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503749888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787397.787213:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.787282:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787397.787291:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503750016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787397.787303:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503749888 00000100:00100000:2.0:1787787397.787309:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503749888 00000100:00100000:3.0:1787787397.787317:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787397.787331:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 21 pid: 17146 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.787341:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750016 00000100:00100000:3.0:1787787397.787344:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750016 00010000:00010000:3.0:1787787397.787356:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 22 pid: 17147 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787397.787356:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787397.787368:0:17138:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787787397.787368:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3654:x1874630503749888:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787397.787377:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787787397.787380:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787397.787385:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 22 pid: 17146 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787397.787390:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787787397.787409:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 22 pid: 17146 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787422:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e0e00/0x11620bc3f30aa004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9ffd expref: 22 pid: 17146 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787434:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787397.787468:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3654:x1874630503749888:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.787475:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787397.787491:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787397.787498:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5bad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3656:x1874630503750016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787397.787505:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787397.787510:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 20 pid: 17147 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787519:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 20 pid: 17147 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787528:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3a00/0x11620bc3f30a9ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30a9fef expref: 20 pid: 17147 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787539:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787555:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787787397.787569:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002402960s 00010000:00010000:2.0:1787787397.787574:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787580:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787586:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787592:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787597:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787397.787601:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787609:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787622:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787632:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787397.787662:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5bad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:3656:x1874630503750016:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.787679:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787397.787708:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503749888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787397.787733:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503750016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787397.787733:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787741:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787397.787747:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f2600/0x11620bc3f30aa0ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1787787397.788074:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787787397.791053:0:18652:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787787397.791063:0:18652:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787787397.791101:0:18652:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787787397.791207:0:18652:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787787397.791227:0:18652:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787787397.791251:0:18652:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787787397.792303:0:18652:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787397.792812:0:18652:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787397.866583:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787397.993712:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787397.993738:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503750144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787397.993809:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.993851:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787397.993859:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503750272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787397.993899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787397.993932:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750144 00000100:00100000:0.0:1787787397.993933:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750272 00000100:00100000:3.0:1787787397.993939:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750144 00000100:00100000:0.0:1787787397.993941:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750272 00000100:00100000:3.0:1787787397.993984:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787397.994363:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503750144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787397.994398:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787787397.994458:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503750144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 465us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.994465:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787397.994486:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787397.994493:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503750272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787397.994510:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787397.994550:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503750272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.994556:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787397.994783:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503750144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787397.994841:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503750272:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787398.889582:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787787398.958459:0:18733:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787398.958826:0:18733:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787787399.530907:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787399.530918:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff987101e33000 from 9 10000000:01000000:0.0:1787787399.530926:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787399.530991:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787399.531030:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787399.531047:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787399.531081:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787399.531197:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787399.533856:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3761540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787399.535180:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750400 00000100:00100000:1.0:1787787399.535205:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750400 00000100:00100000:1.0:1787787399.535280:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787399.535292:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:17149:x1874630503750400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787399.535315:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787399.535341:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa0b3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.535378:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.535391:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.535402:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1400, rc 0) 00000100:00100000:1.0:1787787399.535509:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:17149:x1874630503750400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787399.535517:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787399.535905:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787399.535927:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787399.535939:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787399.536018:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787787399.536069:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787399.536109:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3761540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787399.537357:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750528 00000100:00100000:3.0:1787787399.537371:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750528 00000100:00100000:3.0:1787787399.537590:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787787399.537600:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:17149:x1874630503750528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787787399.537627:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787787399.537664:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787787399.537667:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787787399.538354:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:17149:x1874630503750528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 750us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787399.538367:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787787399.538755:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787399.538869:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787399.538882:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787399.538895:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787399.538909:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787399.538913:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c5465000 from 9 10000000:01000000:2.0:1787787399.538916:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787399.538955:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787399.538965:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787399.538976:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787399.539001:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787399.539057:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787399.539112:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787399.539923:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750656 00000100:00100000:1.0:1787787399.539935:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750656 00000100:00100000:1.0:1787787399.540000:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787787399.540011:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:17149:x1874630503750656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787399.540026:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787399.540057:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa0c1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.540088:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.540101:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.540112:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1000, rc 0) 00000100:00100000:1.0:1787787399.540194:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503750656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787399.540202:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787787399.540252:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787399.540270:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.540281:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787399.540345:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787787399.540381:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787399.540413:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870edad0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787399.540485:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750784 00000100:00100000:3.0:1787787399.540490:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750784 00000100:00100000:3.0:1787787399.540526:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787787399.540534:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503750784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787787399.540555:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787787399.540572:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787787399.540575:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787787399.540656:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503750784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787399.540663:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787399.541889:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503750784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787787399.541968:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787399.541979:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787399.542001:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787399.917271:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787400.937579:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787401.962234:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787402.990942:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787403.113395:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503750912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787403.113472:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787403.114898:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787403.114905:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787403.114908:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787403.114910:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787403.114938:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787403.114942:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787403.114944:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787403.114947:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787787403.114994:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503751040:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115053:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.115086:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503751552:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115115:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.115171:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787787403.115178:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503751168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115216:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.115236:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503751680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115259:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.115286:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503751296:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115308:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.115327:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787403.115332:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503751424:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115353:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.115383:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751040 00000100:00100000:0.0:1787787403.115390:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751040 00000100:00100000:0.0:1787787403.115437:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787403.115446:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3655:x1874630503751040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115494:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3655:x1874630503751040:12345-0@lo:400:kworker.0 Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787403.115512:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787403.115548:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751552 00000100:00100000:0.0:1787787403.115552:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751552 00000100:00100000:0.0:1787787403.115596:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751680 00000100:00100000:0.0:1787787403.115599:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751680 00000100:00100000:0.0:1787787403.115612:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751296 00000100:00100000:0.0:1787787403.115614:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751296 00000100:00100000:0.0:1787787403.115625:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751424 00000100:00100000:0.0:1787787403.115627:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751424 00000100:00100000:0.0:1787787403.115638:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787403.115644:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503751552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.115676:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503751552:12345-0@lo:400:kworker.0 Request processed in 32us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787403.115681:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787403.116369:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503750912 00000100:00100000:1.0:1787787403.116376:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503750912 00000100:00100000:1.0:1787787403.116402:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751168 00000100:00100000:1.0:1787787403.116405:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751168 00000100:00100000:1.0:1787787403.116417:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787403.116423:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503750912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787403.116448:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787787403.116491:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503750912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787403.116497:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787403.116510:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787403.116515:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503751168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787403.116544:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503751168:12345-0@lo:400:kworker.0 Request processed in 29us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787403.116550:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787403.116785:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503751808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787403.116820:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787403.116939:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787403.116947:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503751680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.116982:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503751680:12345-0@lo:400:kworker.0 Request processed in 37us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787403.116988:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787403.117002:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787403.117009:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503751296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.117035:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503751296:12345-0@lo:400:kworker.0 Request processed in 27us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787403.117040:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787403.117050:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787787403.117055:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503751424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.117096:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503751424:12345-0@lo:400:kworker.0 Request processed in 41us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787403.117103:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787787403.118059:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc2e7c00 x1874630503751424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787403.118079:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503751424:0@lo:400:kworker.0 00010000:00080000:3.0:1787787403.118096:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc2e5e00 x1874630503751296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787403.118105:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503751296:0@lo:400:kworker.0 00000100:00100000:0.0:1787787403.118459:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751808 00000100:00100000:0.0:1787787403.118466:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751808 00000100:00100000:0.0:1787787403.118501:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787403.118508:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503751808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787403.118535:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787403.118598:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503751808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787403.118605:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787787403.118652:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787403.118656:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787403.118764:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503750912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787403.118800:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503751168:0@lo:400:kworker.0 00010000:00080000:0.0:1787787403.118814:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc2e5a40 x1874630503751680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787403.118823:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503751680:0@lo:400:kworker.0 00000100:00100000:3.0:1787787403.118945:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503751808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787403.119062:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503751040:0@lo:400:kworker.0 00010000:00080000:0.0:1787787403.119078:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870fc2e4f00 x1874630503751552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787403.119087:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503751552:0@lo:400:kworker.0 00000040:00080000:2.0:1787787403.246806:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787787404.010226:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787404.138580:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787787404.549419:0:19023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787787405.033411:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787787405.472935:0:19075:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787405.473213:0:19075:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787406.057630:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787406.500424:0:19125:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787406.500798:0:19125:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787787407.018620:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787392/real 1787787392] req@ffff986fc4283c00 x1874630503744896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787407 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787407.018654:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4283c00 x1874630503744896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787407 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787407.018664:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787392/real 1787787392] req@ffff986fc4283480 x1874630503745024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787407 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787407.018674:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4283480 x1874630503745024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787407 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787407.018694:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787407.019470:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787787407.019477:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503744896:0@lo:8:kworker.0 00000100:00080000:0.0:1787787407.019484:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787787407.021414:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503751936:0@lo:400:kworker.0 00000100:00100000:3.0:1787787407.021503:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787407.021719:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503751936 00000100:00100000:1.0:1787787407.021728:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503751936 00000100:00100000:1.0:1787787407.021789:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787787407.021798:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3654:x1874630503751936:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787787407.021883:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787407.021888:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787407.021891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787407.021893:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787407.022022:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787787407.022028:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503745024:0@lo:8:kworker.0 00000100:00100000:0.0:1787787407.022094:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503752192:0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022128:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787407.022181:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787407.022187:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503752064:0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022214:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787407.022242:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752192 00000100:00100000:0.0:1787787407.022246:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752192 00000100:00100000:0.0:1787787407.022276:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787407.022282:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503752192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022331:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503752192:12345-0@lo:400:kworker.0 Request processed in 48us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787407.022339:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787407.022361:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752064 00000100:00100000:0.0:1787787407.022365:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752064 00000100:00100000:0.0:1787787407.022392:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787407.022398:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503752064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022428:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503752064:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787407.022434:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787407.022466:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503752064:0@lo:400:kworker.0 00010000:00080000:0.0:1787787407.022477:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400e940 x1874630503752192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787407.022486:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503752192:0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022535:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503752320:0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787407.022604:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752320 00000100:00100000:0.0:1787787407.022608:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752320 00000100:00100000:0.0:1787787407.022627:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787407.022632:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503752320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787407.022663:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503752320:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787407.022669:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787407.022694:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503752320:0@lo:400:kworker.0 00000100:00100000:1.0:1787787407.023388:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3654:x1874630503751936:12345-0@lo:400:kworker.0 Request processed in 1587us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787407.023397:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787787407.023472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787407.023486:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787787407.023500:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787407.023505:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:2.0:1787787407.023509:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787787407.023514:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9870f3637800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787407.023539:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc400da40 x1874630503752448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787407.023554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787407.023557:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787407.023559:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787407.023562:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:2.0:1787787407.023571:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787787407.023576:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870f576d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787407.023587:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc400fc00 x1874630503752576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787407.023650:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787407.023694:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503752448:0@lo:8:kworker.0 00000100:00080000:2.0:1787787407.023955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787407.023959:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787407.023962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787407.023965:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787407.023982:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503752832:0@lo:400:kworker.0 00000100:00100000:2.0:1787787407.024020:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787407.024044:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787407.024050:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503752960:0@lo:400:kworker.0 00000100:00100000:2.0:1787787407.024088:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787407.024164:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752832 00000100:00100000:2.0:1787787407.024169:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752832 00000100:00100000:2.0:1787787407.024208:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752960 00000100:00100000:2.0:1787787407.024211:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752960 00000100:00100000:2.0:1787787407.024231:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787407.024238:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503752832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787407.024281:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503752832:12345-0@lo:400:kworker.0 Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787407.024287:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787407.024300:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787407.024306:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503752960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787407.024332:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503752960:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787407.024338:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787787407.024370:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400f0c0 x1874630503752960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787407.024381:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503752960:0@lo:400:kworker.0 00010000:00080000:2.0:1787787407.024390:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400d680 x1874630503752832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787407.024397:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503752832:0@lo:400:kworker.0 00000100:00080000:2.0:1787787407.024447:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787407.024451:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787407.024935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787407.024976:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503752576:0@lo:8:kworker.0 00000100:00100000:0.0:1787787407.025001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787407.025291:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752448 00000100:00100000:2.0:1787787407.025296:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752448 00000100:00100000:2.0:1787787407.025326:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752576 00000100:00100000:2.0:1787787407.025328:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752576 00000100:00100000:2.0:1787787407.025339:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787407.025354:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503752448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787787407.025385:0:18656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1787787407.025415:0:18656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa0cf 00002000:00100000:2.0:1787787407.025428:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff987101cd9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787787407.025432:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787787407.025435:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787787407.025854:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787787407.025880:0:18656:0:(import.c:65:import_set_state_nolock()) ffff987101cdc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787407.025939:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503752448:12345-0@lo:8:kworker.0 Request processed in 583us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787407.025947:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787407.025963:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787407.025968:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503752576:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787787407.025979:0:18656:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787787407.026179:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400da40 x1874630503752448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787407.026189:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787407.026196:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787787407.026204:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787787407.026209:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787787407.026212:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787787407.026230:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787787407.026235:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503752448:0@lo:8:kworker.0 00000004:00080000:0.0:1787787407.026259:0:17892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787787407.026325:0:17892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 551208185902ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787787407.026332:0:17892:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787787407.026662:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503753088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787407.026703:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787407.026726:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503752704:0@lo:400:kworker.0 00000100:00100000:1.0:1787787407.026747:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787407.029295:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503752704 00000100:00100000:1.0:1787787407.029309:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503752704 00000100:00100000:1.0:1787787407.029367:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787407.029377:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503752704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787407.029446:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503752704:12345-0@lo:400:kworker.0 Request processed in 71us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787407.029453:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787787407.029502:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400f840 x1874630503752704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787407.029517:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503752704:0@lo:400:kworker.0 00000100:00100000:1.0:1787787407.030174:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753088 00000100:00100000:1.0:1787787407.030181:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753088 00000100:00100000:1.0:1787787407.030222:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787407.030229:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503753088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787407.030253:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787787407.030298:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503753088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787407.030321:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787787407.030352:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc4282d00 x1874630503753088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787407.030369:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4282d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503753088:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787787407.030398:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787407.030488:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503751936:0@lo:400:kworker.0 00000004:00080000:0.0:1787787407.035672:0:17893:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787787407.035734:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42821c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1874630503753216:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787787407.036921:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787407.036957:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787407.036990:0:18659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787407.036997:0:18659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787787407.037123:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753216 00000100:00100000:0.0:1787787407.037130:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753216 00000100:00100000:0.0:1787787407.037705:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787407.037716:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17893:x1874630503753216:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1787787407.046680:0:19137:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787787407.046691:0:19137:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787787407.046872:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17893:x1874630503753216:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9153us (9950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787407.046883:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787787407.047674:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc42821c0 x1874630503753216/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787423 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787407.047690:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42821c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1874630503753216:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787787407.047703:0:17893:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787787407.047742:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1874630503753344:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787787407.047845:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787407.047910:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0240 going to sleep for 11 seconds 00000004:00080000:3.0:1787787407.048203:0:17884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787787407.057937:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503752576:12345-0@lo:8:kworker.0 Request processed in 31959us (32927us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787407.057950:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787787407.058011:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787407.058016:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787407.058020:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503752576:0@lo:8:kworker.0 00000100:00100000:2.0:1787787407.058047:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753344 00000100:00100000:2.0:1787787407.058338:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753344 00000100:00100000:0.0:1787787407.059774:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787407.059788:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17893:x1874630503753344:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787787407.059820:0:18659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787787407.059894:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17893:x1874630503753344:12345-0@lo:5:osp-pre-0-1.0 Request processed in 110us (12049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787407.059901:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787787407.059945:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9870d4e62940 x1874630503753344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787423 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787407.059958:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1874630503753344:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787787407.059971:0:17893:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787787407.060014:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1874630503753472:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787787407.060046:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787407.060077:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787407.060091:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753472 00000100:00100000:0.0:1787787407.060096:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753472 00000100:00100000:0.0:1787787407.060120:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787407.060126:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17893:x1874630503753472:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787787407.060165:0:18659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1787787407.086645:0:18653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787787407.086666:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1787787407.086751:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787407.086868:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17893:x1874630503753472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 26735us (26815us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787787407.086911:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787787407.086962:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc4281680 x1874630503753472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787423 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787407.086984:0:17893:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787787407.086992:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1874630503753472:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787787407.087009:0:17893:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787787407.087206:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17893:1874630503753600:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787787407.087247:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787407.087275:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d841d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787407.089175:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753600 00000100:00100000:1.0:1787787407.089190:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753600 00000100:00100000:1.0:1787787407.089237:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787407.089246:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17893:x1874630503753600:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787787407.089335:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17893:x1874630503753600:12345-0@lo:900:osp-pre-0-1.0 Request processed in 90us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787407.089343:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787787407.090359:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400fc00 x1874630503753600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787423 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787407.090376:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17893:1874630503753600:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787787408.106525:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787408.233363:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503753856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787408.233498:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787408.233548:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503753728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787408.233604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787408.233702:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753856 00000100:00100000:2.0:1787787408.233721:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753856 00000100:00100000:2.0:1787787408.233780:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753728 00000100:00100000:2.0:1787787408.233784:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753728 00000100:00100000:2.0:1787787408.233802:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787408.233811:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503753856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787408.233860:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787787408.233920:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503753856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787408.233927:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787408.233947:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787408.233953:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503753728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787408.233971:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787408.234000:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503753728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787408.234015:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787408.234182:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503753856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787408.234196:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503753728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787409.131654:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787410.154118:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787411.178946:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787412.201663:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787412.329602:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787412.329611:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787412.329615:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787412.329619:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787412.329664:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787412.329669:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787412.329673:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787412.329684:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00080000:2.0:1787787412.329692:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787787412.329700:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870f576d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787412.329729:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc36ef480 x1874630503754624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787412.329792:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503754240:0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.329880:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787412.329951:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503754880:0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.329977:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787412.330010:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787412.330017:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503754368:0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.330047:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787412.330067:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503755008:0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.330111:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787412.330178:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503754624:0@lo:8:kworker.0 00000100:00100000:2.0:1787787412.330211:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787412.330257:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754240 00000100:00100000:2.0:1787787412.330266:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754240 00000100:00100000:2.0:1787787412.330322:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754880 00000100:00100000:2.0:1787787412.330327:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754880 00000100:00100000:2.0:1787787412.330354:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755008 00000100:00100000:2.0:1787787412.330357:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755008 00000100:00100000:2.0:1787787412.330376:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787412.330398:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503754240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.330463:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503754240:12345-0@lo:400:kworker.0 Request processed in 77us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787412.330472:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787412.330498:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787787412.330505:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503754880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.330536:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503754880:12345-0@lo:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787412.330542:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787787412.330554:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787412.330561:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503755008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.330589:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503755008:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787412.330595:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787412.330620:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754368 00000100:00100000:2.0:1787787412.330624:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754368 00000100:00100000:2.0:1787787412.330655:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787412.330670:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503754368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787412.330705:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503754368:12345-0@lo:400:kworker.0 Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787412.330711:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787412.330739:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754624 00000100:00100000:2.0:1787787412.330743:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754624 00000100:00100000:2.0:1787787412.330764:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787412.330769:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503754624:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787787412.330793:0:18656:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787787412.331720:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503753984:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.331795:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787412.331847:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503754496:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.331877:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787412.331907:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787787412.331914:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503754112:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.331942:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787412.331963:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503754752:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.331990:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787412.333701:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754496 00000100:00100000:0.0:1787787412.333719:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754496 00000100:00100000:0.0:1787787412.333824:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787412.333837:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503754496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.333920:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503753984 00000100:00100000:3.0:1787787412.333938:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503753984 00000100:00100000:0.0:1787787412.333962:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503754496:12345-0@lo:400:kworker.0 Request processed in 125us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787412.333974:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787412.334040:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787787412.334053:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3655:x1874630503753984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.334171:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3655:x1874630503753984:12345-0@lo:400:kworker.0 Request processed in 120us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787412.334178:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787787412.334245:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754112 00000100:00100000:3.0:1787787412.334249:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754112 00000100:00100000:3.0:1787787412.334272:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787412.334278:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.334318:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503754112:12345-0@lo:400:kworker.0 Request processed in 40us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787412.334324:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787412.334824:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787412.334846:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503755136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787412.334909:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787412.334969:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755136 00000100:00100000:0.0:1787787412.334975:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755136 00000100:00100000:0.0:1787787412.335014:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787412.335024:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503755136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787412.335053:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787787412.335098:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503755136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787412.335105:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787787412.335173:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc4281680 x1874630503755136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787412.335199:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503755136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787412.335803:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503754112:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.335865:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503753984:0@lo:400:kworker.0 00010000:00080000:3.0:1787787412.335881:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400da40 x1874630503754496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787412.337712:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787412.337745:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787412.337750:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787412.337781:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503754752 00000100:00100000:0.0:1787787412.337795:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503754752 00000100:00100000:0.0:1787787412.337880:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787787412.337892:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787412.338003:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503754752:12345-0@lo:400:kworker.0 Request processed in 113us (6011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787412.338012:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787787412.338098:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503754368:0@lo:400:kworker.0 00010000:00080000:0.0:1787787412.338121:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc36eed00 x1874630503755008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787412.338135:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503755008:0@lo:400:kworker.0 00010000:00080000:0.0:1787787412.338176:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400cb40 x1874630503754240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787412.338187:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503754240:0@lo:400:kworker.0 00010000:00080000:0.0:1787787412.338202:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc36ee1c0 x1874630503754880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787412.338213:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503754880:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.341018:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503754496:0@lo:400:kworker.0 00010000:00080000:3.0:1787787412.341112:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc36ec780 x1874630503754752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787412.341131:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503754752:0@lo:400:kworker.0 00000100:00100000:3.0:1787787412.360060:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503754624:12345-0@lo:8:kworker.0 Request processed in 29279us (29838us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787412.360085:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787787412.360632:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787412.360648:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787412.360655:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503754624:0@lo:8:kworker.0 00010000:00010000:0.0:1787787413.226452:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787413.354348:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503755264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787413.354437:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787413.354495:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755264 00000100:00100000:1.0:1787787413.354502:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755264 00000100:00100000:1.0:1787787413.354546:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787413.354555:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503755264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787413.354589:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787413.354634:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503755264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787413.354641:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787413.355393:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503755392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787413.355501:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787413.355565:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755392 00000100:00100000:2.0:1787787413.355570:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755392 00000100:00100000:2.0:1787787413.355713:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787413.355798:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503755392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787413.355831:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787787413.356013:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503755392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 290us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787413.356021:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787413.356071:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503755392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787413.361011:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503755264:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787787413.491098:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1787787414.088675:0:19471:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787787414.088680:0:19471:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787787414.088688:0:19471:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787787414.088807:0:19471:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff987101cdc800 00000020:01000004:2.0:1787787414.088825:0:19471:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787787414.088839:0:19471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787787414.088853:0:19471:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff987101db19b8) 00000020:00000080:2.0:1787787414.088869:0:19471:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787787414.188714:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787787414.194747:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787787414.194954:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787787414.195269:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787787414.196491:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787787414.196879:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787787414.197121:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1787787414.201482:0:19471:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787787414.201719:0:19471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787787414.201735:0:19471:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787787414.201748:0:19471:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x11620bc3f30aa0dd 00000020:01000004:1.0:1787787414.201755:0:19471:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787787414.201779:0:19471:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787787414.201783:0:19471:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787787414.201790:0:19471:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787787414.201819:0:19471:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787787414.201824:0:19471:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787787414.235209:0:19471:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787787414.235269:0:19471:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.131@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787787414.235274:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787787414.235275:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787787414.235277:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787414.235283:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787414.235284:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787414.235286:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787414.235287:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787787414.235289:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787414.235290:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787787414.235293:0:19471:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787787414.235295:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787787414.235296:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787787414.235297:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787414.235298:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787414.235299:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787414.235300:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787414.235301:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787787414.235302:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787414.235303:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787787414.235335:0:19471:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787787414.235368:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755520:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787787414.235475:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.235518:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787414.235650:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755520 00000100:00100000:2.0:1787787414.235660:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755520 00000100:00100000:2.0:1787787414.235719:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787787414.235729:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:19471:x1874630503755520:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787787414.235760:0:17146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787787414.235763:0:17146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787787414.235767:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787787414.236302:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:19471:x1874630503755520:12345-0@lo:253:mount.lustre.0 Request processed in 572us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787414.236312:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787414.238911:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755520:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787787414.238936:0:19471:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787787414.238939:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787787414.238941:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787787414.238942:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787414.238944:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787414.238945:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787414.238946:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787414.238947:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787787414.238949:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787414.238950:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787787414.238980:0:19471:0:(tgt_mount.c:101:server_register_mount()) register mount ffff987101cdc800 from lustre-OST0001 10000000:01000000:1.0:1787787414.239018:0:19471:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787787414.239022:0:19471:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787787414.239031:0:19471:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9870fc36b370 local copy 00010000:00010000:1.0:1787787414.239043:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787414.239187:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787414.239257:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.239311:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787414.239424:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755648 00000100:00100000:3.0:1787787414.239430:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755648 00000100:00100000:3.0:1787787414.239485:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787787414.239495:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:19471:x1874630503755648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787414.239586:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:19471:x1874630503755648:12345-0@lo:501:mount.lustre.0 Request processed in 92us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787414.239594:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787787414.239808:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755648:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787787414.239824:0:19471:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787787414.239845:0:19471:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787787414.239852:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.239862:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787414.239887:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff987101cdc800 10000000:01000000:2.0:1787787414.239892:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787787414.239897:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787787414.239900:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787414.239912:0:19471:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787787414.239915:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787787414.239938:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.239945:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.239954:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787414.239967:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787414.239998:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787414.240022:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.240081:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755776 00000100:00100000:1.0:1787787414.240086:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755776 00000100:00100000:1.0:1787787414.240120:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787787414.240127:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:19471:x1874630503755776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787414.240135:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787414.240170:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa0e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.240192:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa0e4 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.240204:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa0e4 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.240212:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1e00, rc 0) 00000100:00100000:1.0:1787787414.240239:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503755776:12345-0@lo:101:mount.lustre.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.240245:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787787414.240574:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787414.240588:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.240598:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787414.242169:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787787414.244670:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787414.248332:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787787414.248418:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787787414.248438:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787787414.248453:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787787414.248466:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787787414.248478:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787787414.248500:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787787414.248513:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787787414.248626:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787414.248698:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787414.248739:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.249063:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503755904 00000100:00100000:1.0:1787787414.249071:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503755904 00000100:00100000:1.0:1787787414.249111:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787787414.249121:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503755904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787414.249306:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503755904:12345-0@lo:501:mount.lustre.0 Request processed in 186us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.249322:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787787414.249679:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503755904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787414.249720:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787414.249766:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787414.249799:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787787414.249851:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787414.250505:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756032 00000100:00100000:1.0:1787787414.250512:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756032 00000100:00100000:1.0:1787787414.250577:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787414.250588:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787414.252289:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756032:12345-0@lo:503:mount.lustre.0 Request processed in 1691us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.252304:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787787414.252583:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787787414.253024:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787414.253123:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787414.253211:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787414.253250:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.253596:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756160 00000100:00100000:1.0:1787787414.253603:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756160 00000100:00100000:1.0:1787787414.253646:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787414.253656:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787414.254629:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756160:12345-0@lo:502:mount.lustre.0 Request processed in 969us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.254640:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787787414.255648:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787414.255930:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787787414.255961:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787787414.255978:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787787414.255992:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787787414.256005:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787787414.256018:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787787414.256030:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787787414.256042:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787787414.256055:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787787414.256093:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787414.256185:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787414.256231:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787414.256431:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756288 00000100:00100000:3.0:1787787414.256439:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756288 00000100:00100000:3.0:1787787414.256493:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787787414.256503:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787414.256618:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756288:12345-0@lo:502:mount.lustre.0 Request processed in 115us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787414.256626:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787414.258973:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787414.259078:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787787414.259092:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787787414.260118:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787414.260128:0:19475:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787787414.260134:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.260160:0:19475:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787787414.260167:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787414.260184:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9870d22f4d28) 00000020:00000080:3.0:1787787414.260209:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787787414.260215:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787787414.260300:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff987101cdc800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787787414.260309:0:19475:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787787414.260317:0:19475:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x11620bc3f30aa0f9 00010000:00010000:3.0:1787787414.264874:0:19475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787787414.265940:0:19475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1787787414.267884:0:19475:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787787414.270803:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787787414.270818:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.270825:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.270827:0:19475:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787787414.270831:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787414.270841:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.270843:0:19475:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787414.270845:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787414.270848:0:19475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787787414.270850:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.270852:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.270853:0:19475:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787787414.270855:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787414.270858:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.270859:0:19475:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787787414.270863:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787787414.270891:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.270895:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.270896:0:19475:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787787414.270900:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787787414.271167:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787787414.271198:0:19471:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787787414.271223:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.271235:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787414.271242:0:19471:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff987101cdc800 from 1 10000000:01000000:0.0:1787787414.271246:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787414.271285:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.271292:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.271304:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787414.271329:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787414.271416:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.271456:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787414.272734:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756416 00000100:00100000:3.0:1787787414.272747:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756416 00000100:00100000:3.0:1787787414.272803:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787787414.272813:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:19471:x1874630503756416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787414.272829:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787414.272845:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa100 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.272874:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.272885:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.272894:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc39f3600, rc 0) 00000100:00100000:3.0:1787787414.273032:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756416:12345-0@lo:101:mount.lustre.0 Request processed in 220us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787414.273054:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787414.276782:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787414.276814:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.276827:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787414.283429:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787787414.283771:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787414.283997:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787787414.284023:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787787414.284041:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787787414.284046:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787787414.284115:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787414.284220:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.284271:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3ade000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.286996:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756544 00000100:00100000:1.0:1787787414.287015:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756544 00000100:00100000:1.0:1787787414.287081:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787414.287092:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787414.287319:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756544:12345-0@lo:501:mount.lustre.0 Request processed in 228us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.287327:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787414.287627:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787414.288295:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787414.288374:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.288541:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756672 00000100:00100000:0.0:1787787414.288549:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756672 00000100:00100000:0.0:1787787414.288598:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787414.288608:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787414.288726:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756672:12345-0@lo:503:mount.lustre.0 Request processed in 119us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.288733:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787787414.289130:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.289177:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787787414.291914:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787414.292045:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787414.292124:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.292260:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756800 00000100:00100000:0.0:1787787414.292267:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756800 00000100:00100000:0.0:1787787414.292317:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787414.292325:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787414.296091:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756800:12345-0@lo:502:mount.lustre.0 Request processed in 3756us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.296108:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787787414.299241:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.299291:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787414.300005:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787787414.300047:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787787414.300063:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787787414.300076:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787787414.300090:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787787414.300102:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787787414.300117:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787787414.300129:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787787414.300273:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787787414.300290:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787787414.300303:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787787414.300366:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787414.301015:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.301335:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787414.304042:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503756928 00000100:00100000:2.0:1787787414.304059:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503756928 00000100:00100000:2.0:1787787414.304128:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787787414.304158:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787414.304339:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503756928:12345-0@lo:502:mount.lustre.0 Request processed in 202us (3326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787414.304347:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787787414.304517:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503756928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787414.304611:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787787414.304623:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787787414.305564:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787414.305577:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305579:0:19479:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787414.305587:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff987101cdc800 00000020:00000080:3.0:1787787414.305590:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787414.305599:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.305601:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305602:0:19479:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787787414.305605:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787414.305608:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305609:0:19479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787414.305613:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff987101cdc800 00000020:00000080:3.0:1787787414.305616:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787414.305785:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.305790:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305791:0:19479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787787414.305794:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787414.305796:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305797:0:19479:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787414.305800:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff987101cdc800 00000020:00000080:3.0:1787787414.305802:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787414.305819:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.305822:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305823:0:19479:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787414.305826:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787414.305828:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305829:0:19479:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787787414.305833:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff987101cdc800 00000020:00000080:3.0:1787787414.305835:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787414.305858:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787414.305860:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787414.305868:0:19479:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787787414.305871:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787787414.309024:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787787414.309067:0:19471:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787414.309094:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.309108:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787414.309197:0:19471:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787414.309200:0:19471:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff987101cdc800 10000000:01000000:1.0:1787787414.309204:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff987101cdc800 10000000:01000000:1.0:1787787414.309209:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787414.309215:0:19471:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff987101cdc800 from 1 10000000:01000000:1.0:1787787414.309218:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787414.309253:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.309262:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.309273:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787414.309300:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787414.309380:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.309495:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787414.310567:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757056 00000100:00100000:0.0:1787787414.310579:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757056 00000100:00100000:0.0:1787787414.310635:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787787414.310657:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:19471:x1874630503757056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787414.310674:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787414.310689:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15a00/0x11620bc3f30aa115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa10e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.310716:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15a00/0x11620bc3f30aa115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa10e expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.310727:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15a00/0x11620bc3f30aa115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa10e expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.310750:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15a00, rc 0) 00000100:00100000:0.0:1787787414.310805:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757056:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.310812:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787787414.312599:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787414.312628:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.312651:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787414.313963:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1787787414.314293:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787414.314847:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787787414.314875:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787787414.314891:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787787414.314905:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787787414.314919:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787787414.314932:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787787414.314944:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787787414.314956:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787787414.314970:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787787414.314999:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787787414.315015:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787787414.315029:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787787414.315042:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787787414.315056:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787787414.315069:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787787414.315081:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787787414.315093:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787787414.315106:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787787414.315117:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787787414.315129:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787787414.315521:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787787414.315743:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787787414.315760:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787787414.315786:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787787414.315797:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787787414.315838:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787787414.315855:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787787414.315869:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787787414.315881:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787787414.315894:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787787414.315906:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787787414.315921:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787787414.315933:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787787414.315944:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787787414.315955:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787787414.315965:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787787414.315976:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787787414.315988:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787787414.316002:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1787787414.316016:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1787787414.316029:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1787787414.316056:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1787787414.316073:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1787787414.316086:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1787787414.316099:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1787787414.316111:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1787787414.318271:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787787414.330581:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787787414.330791:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787414.330861:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.330907:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787414.330997:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757184 00000100:00100000:0.0:1787787414.331004:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757184 00000100:00100000:0.0:1787787414.331052:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787414.331062:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787414.331200:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757184:12345-0@lo:501:mount.lustre.0 Request processed in 140us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.331207:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787414.331255:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787414.331287:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787414.331331:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.331360:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.334090:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757312 00000100:00100000:1.0:1787787414.334107:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757312 00000100:00100000:1.0:1787787414.334180:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787787414.334191:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787414.334364:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757312:12345-0@lo:503:mount.lustre.0 Request processed in 174us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.334372:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787787414.334771:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757312:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787787414.335254:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787414.335330:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787414.335398:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.340506:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.341517:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757440 00000100:00100000:1.0:1787787414.341538:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757440 00000100:00100000:1.0:1787787414.341596:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787787414.341604:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787414.341792:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757440:12345-0@lo:502:mount.lustre.0 Request processed in 188us (6393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.341801:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787787414.342795:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787414.343054:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787787414.343089:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787787414.343103:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787787414.343118:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787787414.343129:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787787414.343165:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787787414.343180:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787787414.343193:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787787414.343207:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787787414.343220:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787787414.343233:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787787414.343246:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787787414.343261:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787787414.343275:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787787414.343288:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787787414.343302:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787787414.343334:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787787414.343362:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787787414.343377:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787787414.343390:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787787414.346619:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787787414.346756:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787787414.346774:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787787414.346788:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787787414.346802:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787787414.346817:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787787414.346832:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787787414.346845:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787787414.346857:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787787414.346870:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787787414.346898:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787787414.346914:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787787414.346945:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787787414.346960:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787787414.346974:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787787414.346986:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787787414.346999:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787787414.347014:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787787414.347029:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787787414.347043:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787787414.347057:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787787414.347069:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787787414.347081:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787787414.347092:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787787414.347103:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787787414.347114:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787787414.347125:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787787414.347156:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787787414.347233:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787414.347313:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.347375:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787414.347823:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757568 00000100:00100000:1.0:1787787414.347832:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757568 00000100:00100000:1.0:1787787414.347891:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787787414.347901:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787414.348033:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757568:12345-0@lo:502:mount.lustre.0 Request processed in 133us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.348041:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787787414.349775:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787414.350002:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787787414.350031:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787787414.350071:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787414.350159:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.350198:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787414.350220:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757696 00000100:00100000:0.0:1787787414.350227:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757696 00000100:00100000:0.0:1787787414.350273:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787787414.350291:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787414.353291:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503757696:12345-0@lo:502:mount.lustre.0 Request processed in 2992us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.353305:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787787414.354238:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503757696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787414.354337:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787787414.354362:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787787414.361866:0:19484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787787414.361903:0:19484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff986fc2968000) 00000020:00000080:0.0:1787787414.361931:0:19484:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787787414.362041:0:19484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff987101cdc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787414.362046:0:19484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff987101cdc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787414.362049:0:19484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101cdc800 3 00010000:00080000:0.0:1787787414.362081:0:19484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc438a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787414.374641:0:19484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787787414.376432:0:19484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787787414.376480:0:19484:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787414.376492:0:19484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x11620bc3f30aa123 00000100:00080000:0.0:1787787414.376503:0:19484:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787414.376510:0:19484:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff986fc438a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787414.376547:0:19484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4281680 x1874630503757824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787414.376579:0:19484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787787414.376623:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787414.376627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787414.376630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787414.376638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787414.376666:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787414.376669:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787787414.376672:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787414.376676:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1787787414.376679:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787787414.376683:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870f576d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787414.376695:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc400f840 x1874630503758464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787414.376741:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503757952:0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.376813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.376845:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503758592:0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.376869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.376891:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787414.376897:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503758336:0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.376922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.376954:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757952 00000100:00100000:0.0:1787787414.376960:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757952 00000100:00100000:0.0:1787787414.377005:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787414.377015:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503757952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.377068:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503757952:12345-0@lo:400:kworker.0 Request processed in 55us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.377074:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787414.377092:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758592 00000100:00100000:0.0:1787787414.377096:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758592 00000100:00100000:0.0:1787787414.377127:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787414.377133:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503758592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.377196:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503758592:12345-0@lo:400:kworker.0 Request processed in 63us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.377202:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787414.377218:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758336 00000100:00100000:0.0:1787787414.377222:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758336 00000100:00100000:0.0:1787787414.377255:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787414.377261:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503758336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.377290:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503758336:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.377296:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787787414.377334:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400cb40 x1874630503758336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787414.377346:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503758336:0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.377370:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503757952:0@lo:400:kworker.0 00010000:00080000:0.0:1787787414.377378:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc3a04b40 x1874630503758592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787414.377384:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503758592:0@lo:400:kworker.0 00000100:00080000:0.0:1787787414.377410:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787414.379505:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503757824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787414.379583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.379629:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503758464:0@lo:8:kworker.0 00000100:00100000:1.0:1787787414.379657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.379692:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503758080:0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.379715:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.379733:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503758720:0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.379778:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.379802:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787787414.379808:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503758208:0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.379832:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.379862:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503758848:0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.379886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.379919:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503757824 00000100:00100000:1.0:1787787414.379926:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503757824 00000100:00100000:1.0:1787787414.379950:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758080 00000100:00100000:1.0:1787787414.379953:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758080 00000100:00100000:1.0:1787787414.379972:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758720 00000100:00100000:1.0:1787787414.379975:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758720 00000100:00100000:1.0:1787787414.380011:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758848 00000100:00100000:1.0:1787787414.380014:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758848 00000100:00100000:1.0:1787787414.380031:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787414.380039:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503758080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.380085:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503758080:12345-0@lo:400:kworker.0 Request processed in 47us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.380092:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787414.380106:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787414.380112:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503758720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.380133:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503758720:12345-0@lo:400:kworker.0 Request processed in 21us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.380154:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787414.380165:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787414.380170:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787414.380193:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503758848:12345-0@lo:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.380198:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787414.380208:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787414.380212:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503757824:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787787414.381652:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758208 00000100:00100000:0.0:1787787414.381664:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758208 00000100:00100000:0.0:1787787414.381711:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787787414.381720:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503758208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787414.381785:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503758208:12345-0@lo:400:kworker.0 Request processed in 67us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.381799:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787787414.381841:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758464 00000100:00100000:0.0:1787787414.381846:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758464 00000100:00100000:0.0:1787787414.381871:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787414.381875:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503758464:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787787414.381929:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503758464:12345-0@lo:8:kworker.0 Request processed in 52us (2270us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787787414.381935:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:0.0:1787787414.382050:0:19484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787787414.382064:0:19484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff986fc29699b8) 00000020:00000080:0.0:1787787414.382081:0:19484:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787787414.382169:0:19484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff987101cdc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787414.382174:0:19484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff987101cdc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787787414.382176:0:19484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101cdc800 3 00010000:00080000:0.0:1787787414.382208:0:19484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc4388000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.131@tcp at head 00010000:00080000:1.0:1787787414.383080:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1787787414.383113:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x11620bc3f30aa131 00000004:00100000:1.0:1787787414.383128:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787787414.383173:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9870f03bb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787414.383225:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874630503757824:12345-0@lo:38:llog_process_th.0 Request processed in 3011us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.383233:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787414.383289:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503758208:0@lo:400:kworker.0 00010000:00080000:1.0:1787787414.383304:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc3a07840 x1874630503758848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787414.383313:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503758848:0@lo:400:kworker.0 00010000:00080000:1.0:1787787414.383325:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc400fc00 x1874630503758080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787414.383334:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503758080:0@lo:400:kworker.0 00010000:00080000:1.0:1787787414.383345:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc3a043c0 x1874630503758720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787414.383365:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503758720:0@lo:400:kworker.0 00010000:00080000:1.0:1787787414.384630:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc4281680 x1874630503757824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787414.384643:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787414.384652:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787787414.384659:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787787414.384664:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787787414.384673:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787787414.384680:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503757824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787414.384701:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787414.384705:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787414.384709:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787787414.384713:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503758464:0@lo:8:kworker.0 00000100:00080000:1.0:1787787414.384814:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787414.384819:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787787414.386761:0:19484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787787414.387191:0:19484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787787414.387728:0:19484:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787414.387741:0:19484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x11620bc3f30aa138 00000100:00080000:0.0:1787787414.387755:0:19484:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787414.387762:0:19484:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff986fc4388000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787414.387807:0:19484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc3a04b40 x1874630503758976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787414.387843:0:19484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787787414.387872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787414.387876:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787414.387879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787414.387891:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787414.388057:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503758976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787414.388122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.388254:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503758976 00000100:00100000:0.0:1787787414.388262:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503758976 00000100:00100000:0.0:1787787414.388305:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787414.388313:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503758976:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787787414.388339:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:0.0:1787787414.388381:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x11620bc3f30aa13f 00000004:00100000:0.0:1787787414.388402:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787787414.388874:0:17154:0:(import.c:65:import_set_state_nolock()) ffff986fc4389800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787414.389543:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874630503758976:12345-0@lo:38:llog_process_th.0 Request processed in 1225us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.389557:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1787787414.389682:0:19484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787787414.389738:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787787414.389785:0:19471:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787414.389802:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787414.389813:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787414.389870:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787414.389872:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787414.389873:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787414.389874:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787414.389875:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787414.389876:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787414.389878:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787414.389880:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787414.389881:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787414.389890:0:19471:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787787414.389892:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787414.389894:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787414.389894:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787414.389895:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787414.389896:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787414.389897:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787414.389898:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787414.389899:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787414.389900:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787414.389919:0:19471:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787787414.389933:0:19471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503759104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787414.389982:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.390002:0:19471:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787414.390023:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759104 00000100:00100000:0.0:1787787414.390028:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759104 00000100:00100000:0.0:1787787414.390062:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787787414.390071:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503759104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787414.390093:0:17147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787787414.390107:0:17147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000040:00080000:3.0:1787787414.391060:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 20000000:01000000:0.0:1787787414.396046:0:17147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787787414.396068:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787787414.396173:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787414.396184:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787414.396206:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.396224:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.396231:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.396238:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.396273:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787414.396273:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:19471:x1874630503759104:12345-0@lo:253:mount.lustre.0 Request processed in 6201us (6288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787414.396284:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:2.0:1787787414.396288:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 24 pid: 17147 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787414.396303:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503759232:0@lo:104: 00000100:00100000:2.0:1787787414.396342:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787414.396360:0:19471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:655a2ac3-6e05-4716-af47-ef6019dc5f23:19471:1874630503759104:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787414.396374:0:19471:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787787414.396378:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787414.396379:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787414.396381:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787414.396383:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787414.396384:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787414.396391:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787414.396392:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:2.0:1787787414.396394:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787414.396394:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787414.396395:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787787414.396402:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 23 pid: 17146 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1787787414.396408:0:19471:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787787414.396410:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503759360:0@lo:104: 00000100:00100000:2.0:1787787414.396432:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787414.396449:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787414.396469:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759232 00000100:00100000:2.0:1787787414.396480:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759232 00000100:00100000:2.0:1787787414.396508:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759360 00000100:00100000:2.0:1787787414.396511:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759360 00000100:00100000:2.0:1787787414.396598:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787414.396606:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:17168:x1874630503759232:12345-0@lo:104: 00010000:00010000:2.0:1787787414.396619:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.396660:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787414.396665:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:17168:x1874630503759232:12345-0@lo:104: Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787414.396671:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787414.396684:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787414.396689:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503759360:12345-0@lo:104: 00010000:00010000:2.0:1787787414.396695:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787787414.396722:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc3a04b40 x1874630503758976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787414.396733:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787414.396741:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787787414.396749:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787787414.396753:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787787414.396757:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc4388000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787787414.396763:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503758976:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1787787414.397655:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787787414.397662:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:17168:x1874630503759360:12345-0@lo:104: Request processed in 973us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787414.397670:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787414.397878:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503759232:0@lo:104: 00000100:00100000:2.0:1787787414.397890:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1874630503759360:0@lo:104: 00010000:00010000:2.0:1787787414.397977:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.397996:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787414.398002:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.398016:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787414.398020:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.398029:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787414.398037:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787414.398043:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787414.398074:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.398081:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787414.398107:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.398115:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2400/0x11620bc3f30aa0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa0c8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.398126:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787414.398126:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787414.398128:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787414.398130:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787414.398132:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.398167:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787414.398170:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.398176:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787414.398182:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787414.398187:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787414.398203:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.398207:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787414.398213:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.398219:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15400/0x11620bc3f30aa0b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa0ba expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.398231:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787414.398233:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787414.398234:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787414.398821:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503759488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787414.398870:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.398918:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787414.398924:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503759616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787414.398945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787414.398988:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759488 00000100:00100000:1.0:1787787414.399002:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759488 00010000:00010000:1.0:1787787414.399033:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 24 pid: 17147 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787414.399058:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759616 00000100:00100000:1.0:1787787414.399061:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759616 00010000:00010000:1.0:1787787414.399070:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 25 pid: 17146 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787414.399093:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787414.399101:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+25:3653:x1874630503759488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787414.399113:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787414.399118:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 25 pid: 17147 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.399131:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 25 pid: 17147 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787414.399648:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787414.399658:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+25:3653:x1874630503759616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787414.399683:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787414.399688:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 25 pid: 17146 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.403553:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 25 pid: 17146 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.403582:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1400/0x11620bc3f30aa0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa0b3 expref: 25 pid: 17146 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.403598:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787414.403698:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503759616:12345-0@lo:103:ldlm_bl.0 Request processed in 4039us (4749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787414.403719:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787414.404690:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503759616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787414.404774:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa0c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa0c1 expref: 23 pid: 17147 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404791:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404800:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787414.404821:0:17138:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008636411s 00010000:00010000:1.0:1787787414.404827:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404843:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404862:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404876:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404882:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787414.404887:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404894:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404920:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787414.404937:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787414.404984:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.404993:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787414.405000:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3400/0x11620bc3f30aa146 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787414.405045:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3653:x1874630503759488:12345-0@lo:103:ldlm_bl.0 Request processed in 5944us (6174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787414.405061:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787414.414750:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503759488:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1787787414.422450:0:19471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787787414.425258:0:19471:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787787414.425268:0:19471:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787787414.425332:0:19471:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787414.425406:0:19471:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787414.425594:0:19471:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787787414.425615:0:19471:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787787414.427133:0:19471:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787414.427519:0:19471:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787415.275753:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787787415.365880:0:19539:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787415.366124:0:19539:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787787415.403234:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787395/real 1787787395] req@ffff986fc4172d00 x1874630503745792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787415.403268:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4172d00 x1874630503745792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787415.403280:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787395/real 1787787395] req@ffff986fc4170000 x1874630503745920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787415.403293:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4170000 x1874630503745920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787787415.403326:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787415.403358:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787787415.403363:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503745792:0@lo:8:kworker.0 00000100:00080000:1.0:1787787415.403369:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787415.403375:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787787415.403378:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503745920:0@lo:8:kworker.0 00000100:00080000:0.0:1787787415.403620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787415.403625:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787787415.403628:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787415.403633:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1787787415.403638:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787787415.403645:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9870c3ecd000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787415.403665:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc3a07480 x1874630503760000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787415.403678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787415.403680:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787787415.403682:0:36:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787415.403685:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00100000:2.0:1787787415.403686:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503759872:0@lo:400:kworker.0 00000100:00080000:0.0:1787787415.403687:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787787415.403697:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff987101e37800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787415.403708:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc3a07c00 x1874630503760128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787415.403742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787787415.403745:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787787415.403747:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787787415.403751:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787415.403751:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9870f576d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787415.403760:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc3a052c0 x1874630503760640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787415.403785:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503760768:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.403807:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787415.403820:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503760256:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.403823:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503761280:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.403846:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787415.403850:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503760384:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.403864:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787787415.403869:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503759744:0@lo:400:kworker.0 00000100:00100000:0.0:1787787415.403872:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787415.403887:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503761024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.403949:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760768 00000100:00100000:1.0:1787787415.403957:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760768 00000100:00100000:1.0:1787787415.403998:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761280 00000100:00100000:1.0:1787787415.404001:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761280 00000100:00100000:1.0:1787787415.404031:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787415.404040:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503760768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787415.405511:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759872 00000100:00100000:3.0:1787787415.405522:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759872 00000100:00100000:3.0:1787787415.405553:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760384 00000100:00100000:3.0:1787787415.405555:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760384 00000100:00100000:3.0:1787787415.405570:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787415.405578:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787415.405791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.409150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.409360:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503760512:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.409494:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.409524:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503761152:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.409552:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.409588:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760512 00000100:00100000:2.0:1787787415.409668:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760512 00000100:00100000:2.0:1787787415.409724:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787415.409733:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503760512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.409787:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503760512:12345-0@lo:400:kworker.0 Request processed in 56us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787415.409795:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787415.409822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.409842:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503760896:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.409866:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787787415.410708:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a06940 x1874630503760512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787415.410725:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503760512:0@lo:400:kworker.0 00000100:00100000:0.0:1787787415.412028:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503759744 00000100:00100000:0.0:1787787415.412040:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503759744 00000100:00100000:0.0:1787787415.412104:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787787415.412113:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3656:x1874630503759744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412175:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503760768:12345-0@lo:400:kworker.0 Request processed in 8133us (8362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.412188:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787415.412193:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3656:x1874630503759744:12345-0@lo:400:kworker.0 Request processed in 79us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787415.412202:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787787415.412214:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761024 00000100:00100000:1.0:1787787415.412220:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761024 00000100:00100000:1.0:1787787415.412241:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761152 00000100:00100000:1.0:1787787415.412244:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761152 00000100:00100000:1.0:1787787415.412259:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760256 00000100:00100000:1.0:1787787415.412262:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760256 00000100:00100000:1.0:1787787415.412271:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760896 00000100:00100000:1.0:1787787415.412274:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760896 00000100:00100000:1.0:1787787415.412286:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787415.412293:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503761280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412347:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503761280:12345-0@lo:400:kworker.0 Request processed in 54us (8499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787415.412360:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503759744:0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412375:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787787415.412386:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a07840 x1874630503761280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787415.412393:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787415.412400:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503761024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412445:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503761024:12345-0@lo:400:kworker.0 Request processed in 46us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.412451:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787415.412463:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787415.412468:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503761152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412497:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503761152:12345-0@lo:400:kworker.0 Request processed in 29us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.412503:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787415.412513:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787415.412518:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503760256:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787787415.412567:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a04b40 x1874630503761024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787415.412579:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503761024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412760:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503760256:12345-0@lo:400:kworker.0 Request processed in 240us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.412837:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787415.412851:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787415.412858:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503760896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787415.412889:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503760896:12345-0@lo:400:kworker.0 Request processed in 32us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.412895:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787787415.412922:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787415.412926:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787415.413194:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503760000:0@lo:8:kworker.0 00000100:00100000:1.0:1787787415.413246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787415.413280:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503760128:0@lo:8:kworker.0 00000100:00100000:1.0:1787787415.413307:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787415.413324:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503760640:0@lo:8:kworker.0 00000100:00100000:1.0:1787787415.413356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787415.414241:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760000 00000100:00100000:1.0:1787787415.414250:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760000 00000100:00100000:1.0:1787787415.414281:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760128 00000100:00100000:1.0:1787787415.414284:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760128 00000100:00100000:1.0:1787787415.414292:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503760640 00000100:00100000:1.0:1787787415.414294:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503760640 00000100:00100000:1.0:1787787415.414304:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787415.414311:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503760000:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787787415.414342:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503761280:0@lo:400:kworker.0 00010000:00080000:2.0:1787787415.414368:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a06d00 x1874630503760768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787787415.414376:0:18658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000100:00100000:2.0:1787787415.414406:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503760768:0@lo:400:kworker.0 00000020:00000080:1.0:1787787415.414406:0:18658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa14d 00002000:00100000:1.0:1787787415.414423:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9870f03be800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787787415.414429:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787787415.414432:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1787787415.414448:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a043c0 x1874630503761152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787415.414457:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503761152:0@lo:400:kworker.0 00002000:00080000:1.0:1787787415.414505:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787787415.414930:0:18658:0:(import.c:65:import_set_state_nolock()) ffff9870f03b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787415.415066:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503760000:12345-0@lo:8:kworker.0 Request processed in 753us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.415075:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787415.415095:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787415.415100:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503760128:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787787415.415118:0:18658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1787787415.415135:0:18658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa154 00002000:00100000:1.0:1787787415.415171:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9870f03bd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787787415.415175:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787787415.415177:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787787415.415314:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787787415.415340:0:18658:0:(import.c:65:import_set_state_nolock()) ffff9870f03be000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787415.415375:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503760128:12345-0@lo:8:kworker.0 Request processed in 274us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.415382:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787415.415396:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787415.415401:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503760640:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787787415.415416:0:18658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1787787415.415439:0:18658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa15b 00002000:00100000:1.0:1787787415.415446:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9870f03ba000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787787415.415450:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787787415.415452:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787787415.415476:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787787415.415489:0:18658:0:(import.c:65:import_set_state_nolock()) ffff9870f03bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787415.415517:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503760640:12345-0@lo:8:kworker.0 Request processed in 115us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.415879:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787787415.415918:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a07480 x1874630503760000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787415.415928:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787415.415936:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787787415.415944:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787415.415949:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787787415.415961:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787415.416079:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787415.416086:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503760000:0@lo:8:kworker.0 00010000:00080000:1.0:1787787415.416103:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a07c00 x1874630503760128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787415.416112:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787415.416116:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787787415.416121:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787415.416124:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787787415.416126:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787415.416162:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787415.416167:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503760128:0@lo:8:kworker.0 00010000:00080000:1.0:1787787415.416181:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a052c0 x1874630503760640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787787415.416191:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787787415.416195:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787415.416198:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787787415.416200:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787415.416220:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787415.416224:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503760640:0@lo:8:kworker.0 00000004:00080000:1.0:1787787415.416285:0:17177:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787787415.416305:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1874630503761536:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787787415.417086:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787415.417117:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e09203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787415.417152:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761536 00000100:00100000:1.0:1787787415.417157:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761536 00000100:00100000:1.0:1787787415.417221:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787415.417230:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17177:x1874630503761536:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1787787415.417443:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787787415.418525:0:17894:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787787415.418604:0:17894:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 559600464712ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787787415.418611:0:17894:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787787415.418783:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503759872:12345-0@lo:400:kworker.0 Request processed in 13202us (15028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.418793:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787415.418822:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787415.418831:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503760384:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1787787415.418859:0:17176:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787787415.418878:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503760384:12345-0@lo:400:kworker.0 Request processed in 49us (15005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.418884:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1787787415.418947:0:17895:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787787415.418970:0:17895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17895:1874630503761792:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787787415.419029:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787787415.419033:0:17176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559600893567ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787787415.419037:0:17176:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787787415.419045:0:17895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d17900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787415.419167:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761792 00000100:00100000:3.0:1787787415.419174:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761792 00000100:00100000:3.0:1787787415.419219:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787415.419228:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17895:x1874630503761792:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1787787415.419446:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787415.419838:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503759872:0@lo:400:kworker.0 00002000:00080000:1.0:1787787415.420403:0:18658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787787415.420412:0:18658:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787787415.420417:0:18658:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00010000:00080000:0.0:1787787415.420464:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a05e00 x1874630503760256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787415.420477:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503760256:0@lo:400:kworker.0 00000004:00080000:0.0:1787787415.420515:0:17179:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787787415.420531:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1874630503762048:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787787415.420570:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787415.420587:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc1086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787415.420605:0:18656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787787415.420611:0:18656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:0.0:1787787415.420628:0:17178:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787787415.420692:0:17178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559602552693ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787787415.420698:0:17178:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787787415.421291:0:19137:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787787415.421299:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762048 00000100:00100000:3.0:1787787415.421305:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762048 00000100:00080000:3.0:1787787415.421366:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787415.421374:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787415.421383:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503761920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787415.421421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787415.421453:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761920 00000100:00100000:3.0:1787787415.421457:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761920 00000100:00100000:3.0:1787787415.421479:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787415.421486:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503761920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787415.421502:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787787415.421537:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503761920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.421544:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787787415.421571:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc400f0c0 x1874630503761920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787415.421585:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503761920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787415.423388:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503761664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787415.425740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.425817:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503760384:0@lo:400:kworker.0 00000100:00100000:2.0:1787787415.425846:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787415.425856:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503761408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787415.425887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.427086:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761664 00000100:00100000:2.0:1787787415.427098:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761664 00000100:00100000:2.0:1787787415.427148:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503761408 00000100:00100000:2.0:1787787415.427152:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503761408 00000100:00100000:2.0:1787787415.427169:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787415.427177:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1874630503761664:12345-0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1787787415.427689:0:17884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00000024:3.0:1787787415.428182:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787787415.428383:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1874630503761664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1202us (2645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.428403:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787415.428432:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787415.428442:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874630503761408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787415.428476:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787415.428509:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874630503761408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.428516:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787787415.429338:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc10b3480 x1874630503761408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787415.429364:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503761408:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787787415.429379:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e4780 x1874630503761664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787415.429410:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503761664:0@lo:13:osp-pre-1-1.0 00002000:00010000:1.0:1787787415.431897:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.431908:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.431927:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.431933:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.431939:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.431958:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.431969:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.431977:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787787415.432732:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a04000 x1874630503760896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787415.432750:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503760896:0@lo:400:kworker.0 00010000:00010000:1.0:1787787415.434289:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.434836:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.434847:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.434871:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.434876:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.434886:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.434906:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.434914:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aa162 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.434934:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.434936:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.434938:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787415.435954:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.435965:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.435980:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.435984:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.435990:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436114:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436134:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436159:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436182:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787415.436823:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.436831:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436841:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.436846:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.436850:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436862:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436870:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436877:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436913:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787787415.436930:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787415.436935:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436943:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.436948:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436956:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436971:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.436978:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aa169 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437066:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.437070:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437076:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.437081:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437099:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437111:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437119:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002944ad3a/0x11620bc3f30aa170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.437129:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.437133:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.437154:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.437157:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787415.437518:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.437623:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437632:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.437773:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.437779:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437789:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437798:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437812:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437831:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.437841:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.437846:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437853:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.437856:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437865:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437878:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437885:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c62e60da/0x11620bc3f30aa177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.437899:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.437901:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.437903:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787415.437996:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787415.438014:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17179:x1874630503762048:12345-0@lo:5:osp-pre-1-0.0 00002000:00010000:1.0:1787787415.438256:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.438271:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.438281:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.438284:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.438289:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.438299:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.438308:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.438316:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.438346:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787415.439071:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.439078:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.439089:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.439093:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.439097:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.439107:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.439122:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.439128:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.439158:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787415.439208:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787415.439216:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439227:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.439232:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439242:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439274:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439282:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c244542c/0x11620bc3f30aa17e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439299:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.439302:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439310:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.439313:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439321:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439343:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439351:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af25d59f/0x11620bc3f30aa185 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.439522:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.439524:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.439532:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787787415.439542:0:18659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787787415.439548:0:18659:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787787415.439647:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17895:x1874630503761792:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20418us (20614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787415.439658:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00010000:1.0:1787787415.440112:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.440121:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440131:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.440134:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.440160:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440171:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440180:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440188:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440217:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787415.440816:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.440824:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440835:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.440839:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.440843:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440853:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440860:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440873:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.440882:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787787415.441264:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.441278:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.441286:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.441296:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.441301:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.441311:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.441319:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.441326:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.441347:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787787415.441615:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787787415.441624:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441633:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.441638:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441648:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441667:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441675:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548e3cb0/0x11620bc3f30aa18c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441700:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787415.441704:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441710:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.441720:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441728:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441738:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441745:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca48ad83/0x11620bc3f30aa193 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441757:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.441760:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441765:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.441768:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441775:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441783:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441789:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f27108/0x11620bc3f30aa19a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.441807:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.441809:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.441811:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.442026:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787415.444325:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.444349:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.444366:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.444371:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.444377:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.444397:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.444407:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.444422:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.444442:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787787415.444964:0:19542:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787787415.444974:0:19542:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787787415.444980:0:19542:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00010000:00080000:3.0:1787787415.445338:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5e00 x1874630503761792/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787415.445355:0:17895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17895:1874630503761792:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787787415.445368:0:17895:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787787415.445409:0:17895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17895:1874630503762176:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787787415.445464:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787415.445491:0:17895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d17900c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787787415.445519:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787787415.445523:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.445531:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.445541:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.445545:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.445554:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.445571:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.445579:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa996a27/0x11620bc3f30aa1a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.445598:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.445600:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.445602:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787415.445709:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762176 00000100:00100000:3.0:1787787415.445716:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762176 00000100:00100000:3.0:1787787415.445760:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787415.445768:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17895:x1874630503762176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787787415.445793:0:19137:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787787415.445831:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17895:x1874630503762176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.445838:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787787415.445870:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc2e5e00 x1874630503762176/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787415.445881:0:17895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17895:1874630503762176:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787787415.445891:0:17895:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00002000:00010000:1.0:1787787415.446473:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.446482:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446496:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.446501:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.446506:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446517:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446751:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446760:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446779:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.446789:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.446794:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446810:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.446814:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446822:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446835:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446842:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bf15ab0/0x11620bc3f30aa1a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.446860:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.446862:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.446864:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787415.447992:0:17895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17895:1874630503762304:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787787415.448061:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787415.448095:0:17895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d17900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787415.448126:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762304 00000100:00100000:3.0:1787787415.448134:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762304 00000100:00100000:3.0:1787787415.448716:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787415.448726:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17895:x1874630503762304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787787415.448785:0:18659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1787787415.449356:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.449365:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.449386:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.449391:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.449397:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.449410:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.449428:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.449436:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.450089:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.450103:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.450109:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.450120:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.450125:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.450135:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.450196:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.450204:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f371fe50/0x11620bc3f30aa1af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.450228:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.450236:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.450238:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787415.451917:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.451928:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.451941:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.451946:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.451952:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.451964:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.451973:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.451980:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.452374:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787787415.452908:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787787415.452979:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.452987:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.453028:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.453037:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.453050:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.453055:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.453065:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.453084:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.453093:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0be694/0x11620bc3f30aa1b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.453114:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.453116:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.453118:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.453544:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.453548:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.453561:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453573:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453582:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453589:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453603:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.453614:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.453618:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453625:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.453628:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453772:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453786:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453806:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009af0d7ae/0x11620bc3f30aa1bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.453821:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.453822:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.453824:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787415.461752:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.461767:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.461798:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.461804:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.461811:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.461828:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.461840:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.461849:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.461866:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787415.462396:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.462403:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462413:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.462417:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.462421:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462587:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462610:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462627:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462644:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787415.462655:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787415.462661:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462669:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.462674:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462683:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462700:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462708:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aa1c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462726:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.462735:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462742:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.462745:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462753:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462764:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462771:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aa1cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.462784:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.462786:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.462788:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.464584:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787415.464766:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.464775:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.464791:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.464795:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.464801:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.464826:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.464836:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.464844:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.464863:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.465157:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.465165:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.465175:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.465180:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.465190:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.465206:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.465214:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa1d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.465234:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.465236:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.465238:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787415.465609:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.465616:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.465626:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.465630:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.465635:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.465645:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.465654:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.465673:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.465695:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787415.466232:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.466239:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.466249:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.466253:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.466257:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.466268:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.466277:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.466284:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.466297:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787787415.466356:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787415.466364:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466373:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.466377:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466398:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466412:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466420:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa1d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466436:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.466439:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466446:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.466449:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466457:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466466:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466485:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa1e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.466509:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.466511:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.466513:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.466530:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787415.466835:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.466841:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.466851:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.466855:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.466860:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.466874:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.466882:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.466889:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.466909:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.467203:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.467209:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.467218:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.467223:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.467231:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.467247:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.467257:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44728f0/0x11620bc3f30aa1e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.467273:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.467276:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.467277:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787415.467948:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.467956:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.467969:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.467974:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.467979:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.467991:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468000:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468008:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468024:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.468233:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.468241:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.468257:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.468261:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.468269:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.468282:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.468290:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0e5693c/0x11620bc3f30aa1ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787415.468441:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.468447:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468455:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.468465:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.468628:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.468630:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.468633:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.468713:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468726:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468735:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468743:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.468765:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787787415.468968:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.468974:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.468984:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.468987:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.468991:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469000:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469015:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469022:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469078:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787415.469175:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787415.469183:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469200:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.469204:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469213:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469228:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469236:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dec02d5/0x11620bc3f30aa1f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469253:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.469257:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469264:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.469268:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469276:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469277:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.469290:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469304:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa1fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.469318:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.469320:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.469321:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.469449:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.469456:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469465:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.469611:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.469619:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469630:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469639:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469646:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.469675:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787415.469797:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.469803:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469811:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.469814:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469823:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469835:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469849:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e847f60/0x11620bc3f30aa203 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469865:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.469867:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.469869:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787415.469909:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.469916:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469925:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.469929:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.469933:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469945:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469954:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469961:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.469982:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.470641:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.470650:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.470661:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.470666:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.470676:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.470689:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.470697:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000380efc84/0x11620bc3f30aa20a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.470713:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.470715:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.470717:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.473463:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.473496:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.473517:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=559s v=(0 0) 00002000:00010000:2.0:1787787415.473629:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.473643:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.473652:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.473656:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.473663:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.473679:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.473691:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.473700:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.473726:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.473939:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.473944:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.473956:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.473966:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.473973:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.473997:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787415.474251:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787415.474290:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474371:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.474377:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474387:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474412:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474421:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa218 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474439:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.474443:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474452:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.474456:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474464:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787415.474595:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.474606:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.474615:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.474616:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.474619:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.474627:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aef4889/0x11620bc3f30aa211 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474632:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.474645:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.474648:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.474657:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.474755:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474767:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474775:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474782:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474802:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.474846:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.474854:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.474865:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.474869:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.474878:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.474891:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.474900:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ba0733/0x11620bc3f30aa21f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.474928:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.474931:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.474933:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.474938:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.474945:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474953:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.474956:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.474961:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474970:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.474978:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.475414:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.475430:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787415.475506:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.475512:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.475529:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.475533:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.475542:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.475554:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.475561:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bdb59d7/0x11620bc3f30aa226 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.475575:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.475577:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.475579:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787415.475742:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.475749:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475760:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.475764:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.475769:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475786:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475795:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475804:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475818:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.475825:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.475829:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475835:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.475839:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475847:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475858:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475866:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aa22d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.475892:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.475895:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.475897:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787415.476236:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.476243:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.476252:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.476256:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1787787415.476258:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.476261:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476265:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.476276:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476279:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.476288:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.476293:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476295:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.476315:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476319:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476343:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476351:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.476375:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787415.476520:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.476526:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.476535:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.476539:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.476587:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.476599:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.476606:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349387b1/0x11620bc3f30aa23b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.476620:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.476622:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.476624:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787415.477177:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.477184:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477195:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.477199:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.477203:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477214:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477222:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477241:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477263:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.477671:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787415.477836:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787415.477843:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477852:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.477856:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477864:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477877:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477885:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc213333/0x11620bc3f30aa242 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477898:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.477902:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477919:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.477922:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477930:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477940:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477947:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aa234 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.477960:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.477962:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.477963:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.478045:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787415.478209:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.478217:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.478241:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.478245:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.478250:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.478260:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.478269:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.478277:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.478300:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.478322:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.478339:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.478352:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.478355:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.478363:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.478375:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.478382:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aa249 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.478394:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.478396:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.478397:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.479124:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.479131:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479167:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.479171:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.479175:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479186:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479200:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479207:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479221:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.479230:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.479234:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787415.479239:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.479241:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.479246:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.479250:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479258:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.479263:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.479273:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.479277:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.479278:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479297:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e847f60/0x11620bc3f30aa250 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.479302:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479313:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.479323:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.479324:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.479325:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.479342:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787415.480417:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.480426:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.480438:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.480442:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.480446:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.480457:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.480465:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.480471:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.480541:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787787415.481063:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787415.481071:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.481081:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=559s v=(0 0) 00010000:00010000:0.0:1787787415.481085:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787415.481090:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.481100:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.481109:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.481117:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484503:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787787415.484546:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787787415.484556:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484571:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.484577:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484609:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484630:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484639:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aa257 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484672:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787415.484677:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.484684:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.484953:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787787415.485064:0:18658:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1787787415.485181:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17177:x1874630503761536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67948us (68093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787415.485192:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787415.485256:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1874630503761536:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787787415.485272:0:17177:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1787787415.485325:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1874630503762432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787787415.485395:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787415.485420:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787415.485620:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762432 00000100:00100000:0.0:1787787415.485627:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762432 00000100:00100000:0.0:1787787415.485672:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787415.485681:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17177:x1874630503762432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787787415.485720:0:18656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1787787415.486054:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486066:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486083:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486092:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa25e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486132:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.486154:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486163:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.486166:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486174:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486186:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486194:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aa265 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486209:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.486212:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.486214:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.486842:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.486851:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486866:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.486870:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.486883:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486896:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486906:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486913:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.486933:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.487020:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.487028:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.487039:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.487043:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.487053:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.487076:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.487085:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000970d7fb4/0x11620bc3f30aa26c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.487103:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.487105:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.487107:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.488263:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.488273:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488287:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.488291:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.488298:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488310:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488321:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488353:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488372:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787415.488549:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.488556:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.488564:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.488568:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.488577:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.488598:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.488605:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5dde99a/0x11620bc3f30aa273 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.488621:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.488623:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.488625:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.488890:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.488897:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488906:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.488909:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.488914:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488925:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488933:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488941:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.488954:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787787415.489890:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.489899:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.489918:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.489922:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.489927:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.489938:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.489946:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.489953:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.489962:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787415.491051:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787415.491063:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491074:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.491079:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491089:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491107:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491116:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25f195f/0x11620bc3f30aa27a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491164:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.491168:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491176:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.491179:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491188:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491199:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491206:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000778db03f/0x11620bc3f30aa281 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491219:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.491221:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.491223:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787415.491496:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787415.491503:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491514:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787787415.491535:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787415.491541:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491552:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491560:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491567:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.491587:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787415.491773:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787415.491779:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.491787:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787415.491791:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.491799:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.491825:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.491832:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8881b5b/0x11620bc3f30aa288 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.491846:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.491849:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.491851:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.493643:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.493654:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.493668:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.493673:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.493678:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.493761:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.493772:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.493781:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.493816:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.493907:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.494645:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.494652:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.494663:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.494668:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.494673:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.494684:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.496218:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.496229:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.496253:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787415.496545:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787415.496553:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496562:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.496566:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496574:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496593:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496613:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa28f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496634:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.496638:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496644:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.496647:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496655:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496666:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496673:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa296 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.496697:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.496699:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.496702:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.497824:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.498045:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.498055:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.498070:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.498081:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.498087:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.498103:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.498112:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.498118:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.498160:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.498821:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.498829:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.498839:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.498843:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.498853:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.498873:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.498880:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa29d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.498898:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.498900:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.498907:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787787415.499078:0:18653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787787415.499133:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787787415.499344:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17177:x1874630503762432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13659us (13945us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787787415.499354:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787415.499781:0:17177:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787787415.499792:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1874630503762432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787787415.499812:0:17177:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:1.0:1787787415.499898:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.499906:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.499918:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.499922:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.499927:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.499938:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.499946:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.499954:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.499977:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787415.500306:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.500313:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.500324:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.500341:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.500351:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.500604:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.500620:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009af0d7ae/0x11620bc3f30aa2a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.500638:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.500640:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.500641:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787415.501975:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.501985:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502000:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.502005:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.502010:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502036:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502045:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502053:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502070:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787415.502081:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.502086:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502094:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.502099:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502108:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502122:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502130:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f371fe50/0x11620bc3f30aa2ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.502175:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.502177:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.502180:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787415.504456:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787415.504469:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.504485:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1787787415.504489:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787415.504495:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.504507:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.504517:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.504584:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.504607:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787787415.512537:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.512552:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.512571:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.512576:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.512584:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.512616:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.512627:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.512636:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.512749:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787787415.515940:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00080000:0.0:1787787415.515945:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1787787415.515956:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.515974:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=559s v=(0 0) 00000001:00100000:0.0:1787787415.515979:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1787787415.515980:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00000001:00100000:0.0:1787787415.515989:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787787415.515990:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.516007:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.516018:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.516052:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787415.516169:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17895:x1874630503762304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67440us (68104us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787787415.516181:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787787415.516230:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787787415.516235:0:17895:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00010000:00010000:1.0:1787787415.516240:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787415.516246:0:17895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17895:1874630503762304:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1787787415.516265:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc0dd7420) 00000004:00080000:0.0:1787787415.516267:0:17895:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00010000:00010000:1.0:1787787415.516270:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516282:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516301:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516310:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bf15ab0/0x11620bc3f30aa2b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787415.516339:0:17895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17895:1874630503762560:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787787415.516343:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787415.516349:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516357:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.516360:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516369:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516381:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787415.516393:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787415.516402:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541a6a9a/0x11620bc3f30aa2b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516420:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787415.516424:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787415.516425:0:17895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d17900c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787787415.516433:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.516437:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516447:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516460:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.516467:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787415.516469:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787415.516470:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762560 00010000:00010000:1.0:1787787415.516472:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787415.516478:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762560 00000100:00100000:0.0:1787787415.516530:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787415.516539:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17895:x1874630503762560:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787787415.516588:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17895:x1874630503762560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787415.516604:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787787415.516637:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327c3c0 x1874630503762560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787431 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787415.516649:0:17895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17895:1874630503762560:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1787787415.521256:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.521806:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787787415.521818:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.522099:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.524915:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.524930:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.524948:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.524953:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.524960:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.524974:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.524985:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.524993:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.525027:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787415.525356:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787415.525363:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.525378:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.525382:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.525392:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.525409:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.525417:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279d2b00/0x11620bc3f30aa2c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.525435:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.525437:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.525438:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.526862:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.526875:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.526891:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.526895:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.526901:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.526915:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.526925:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.526933:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.526994:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787787415.530543:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.530559:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.530575:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.530585:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.530593:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.530608:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.530619:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.530627:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.535864:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787415.535882:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.535897:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787415.535916:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.535929:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.535953:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.535963:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be886973/0x11620bc3f30aa2ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.536204:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787415.536212:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.536222:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787415.536226:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.536234:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.536247:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.536257:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.536259:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787415.536261:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787415.538503:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787787415.538518:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d36be4/0x11620bc3f30aa2d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.538773:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787415.540597:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787787415.540609:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.540625:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=559s v=(0 0) 00010000:00010000:3.0:1787787415.540629:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787415.540635:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.540648:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.540664:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.540672:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787415.541790:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787787415.541889:0:19542:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1787787415.542004:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17179:x1874630503762048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 103992us (121428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787415.542016:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787415.542076:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1874630503762048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787787415.542093:0:17179:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1787787415.542160:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1874630503762688:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787787415.542201:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787415.542232:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e7e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787415.542235:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762688 00000100:00100000:0.0:1787787415.542243:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762688 00000100:00100000:0.0:1787787415.542288:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787415.542298:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17179:x1874630503762688:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1787787415.542322:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:0.0:1787787415.542347:0:19137:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1787787415.542348:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.542360:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787415.542365:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.542376:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.542402:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.542411:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000839d961a/0x11620bc3f30aa2dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.542429:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.542431:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787415.542433:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787415.549867:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17179:x1874630503762688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7563us (7658us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787787415.549882:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787415.551855:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1874630503762688:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787787415.551873:0:17179:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 10000000:01000000:0.0:1787787415.849426:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787415.849435:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff987101e33000 from 10 10000000:01000000:0.0:1787787415.849441:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787415.849493:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.849504:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.849516:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787415.849543:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503762816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787415.849625:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787415.849675:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787415.849751:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762816 00000100:00100000:1.0:1787787415.849758:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762816 00000100:00100000:1.0:1787787415.849816:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787787415.849828:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503762816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787415.849843:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787415.849857:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa2ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa2e3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.849882:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa2e3 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.849894:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa2e3 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787415.849903:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4a00, rc 0) 00000100:00100000:1.0:1787787415.849949:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503762816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.849970:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787787415.850191:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503762816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787415.850206:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.850214:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787415.850495:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503762944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787787415.850537:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.850573:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787415.850627:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503762944 00000100:00100000:0.0:1787787415.850632:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503762944 00000100:00100000:0.0:1787787415.850671:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787787415.850678:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503762944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787787415.850695:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787787415.850713:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787787415.850716:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787787415.850801:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503762944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787415.850808:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787787415.851228:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503762944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787415.851298:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787415.851305:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.851314:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787415.851342:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787415.851344:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870c5465000 from 10 10000000:01000000:2.0:1787787415.851347:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787415.851369:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.851377:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.851386:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787415.851401:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503763072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787415.851439:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.851469:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787415.852371:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763072 00000100:00100000:0.0:1787787415.852389:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763072 00000100:00100000:0.0:1787787415.852432:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787787415.852441:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503763072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787415.852454:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787415.852468:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c14400/0x11620bc3f30aa2f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa2f1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.852491:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c14400/0x11620bc3f30aa2f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa2f1 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.852501:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c14400/0x11620bc3f30aa2f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa2f1 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787415.852510:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14400, rc 0) 00000100:00100000:0.0:1787787415.852562:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503763072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787415.852569:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787787415.853660:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503763072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787415.853682:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.853693:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787415.853769:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503763200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787787415.853835:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787415.853874:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1451300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787415.853989:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763200 00000100:00100000:1.0:1787787415.853996:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763200 00000100:00100000:1.0:1787787415.854032:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787787415.854041:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503763200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787415.854058:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787415.854076:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787415.854079:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787787415.854194:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503763200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787415.854201:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787415.854507:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503763200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787415.854568:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787415.855527:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787415.855542:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787416.303390:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787417.325779:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787417.452158:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787417.452181:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503763328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787417.452252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787417.452455:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763328 00000100:00100000:3.0:1787787417.452463:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763328 00000100:00100000:3.0:1787787417.452518:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787417.452528:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503763328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787417.452556:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787417.452616:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503763328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787417.452623:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787787417.452643:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787417.452693:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503763328:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787787418.348425:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787418.473288:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503763456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787418.473369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787418.473426:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763456 00000100:00100000:0.0:1787787418.473432:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763456 00000100:00100000:0.0:1787787418.473479:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787418.474473:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503763456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787418.474522:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787418.474585:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503763456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1098us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787418.474593:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787418.474653:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503763456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787418.476805:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503763584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787418.476866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787418.476909:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763584 00000100:00100000:3.0:1787787418.476916:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763584 00000100:00100000:3.0:1787787418.476969:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787418.476977:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503763584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787418.477005:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787787418.477048:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503763584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787418.477055:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787418.477894:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503763584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787787419.370129:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787420.397121:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787420.521381:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503763840:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521462:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521511:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503764352:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521533:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521550:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503764864:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521597:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787787420.521602:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503763712:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521631:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521654:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503764224:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521676:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521692:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503764736:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521709:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521723:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503765248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521746:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521772:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503764096:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521818:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503764608:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521853:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503765120:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.521874:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.521884:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787787420.521889:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503763968:0@lo:400:kworker.0 00000100:00100000:3.0:1787787420.521975:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763840 00000100:00100000:3.0:1787787420.521983:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763840 00000100:00100000:3.0:1787787420.522021:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764352 00000100:00100000:3.0:1787787420.522024:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764352 00000100:00100000:3.0:1787787420.522041:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787420.522050:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503763840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.522062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.522082:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503764480:0@lo:400:kworker.0 00000100:00100000:3.0:1787787420.522118:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503763840:12345-0@lo:400:kworker.0 Request processed in 68us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.522125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787420.522132:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787787420.522183:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503764992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.522204:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.522226:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787420.522245:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.522275:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503764352:12345-0@lo:400:kworker.0 Request processed in 32us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.522280:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787420.522302:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764864 00000100:00100000:0.0:1787787420.522315:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764864 00000100:00100000:2.0:1787787420.522522:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764096 00000100:00100000:2.0:1787787420.522528:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764096 00000100:00100000:0.0:1787787420.522583:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764224 00000100:00100000:0.0:1787787420.522587:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764224 00000100:00100000:0.0:1787787420.522596:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764736 00000100:00100000:0.0:1787787420.522598:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764736 00000100:00100000:0.0:1787787420.522606:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765248 00000100:00100000:0.0:1787787420.522609:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765248 00000100:00100000:2.0:1787787420.523021:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764608 00000100:00100000:2.0:1787787420.523032:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764608 00000100:00100000:2.0:1787787420.523050:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763968 00000100:00100000:2.0:1787787420.523052:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763968 00000100:00100000:2.0:1787787420.523064:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764480 00000100:00100000:2.0:1787787420.523067:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764480 00000100:00100000:2.0:1787787420.523078:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787420.523085:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503764096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.523135:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503764096:12345-0@lo:400:kworker.0 Request processed in 50us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787420.523160:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787420.523182:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787420.523188:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503764608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.523216:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503764608:12345-0@lo:400:kworker.0 Request processed in 29us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787420.523222:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787420.523244:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787420.523250:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503763968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.523287:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503763968:12345-0@lo:400:kworker.0 Request processed in 35us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787420.523293:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787420.523304:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787420.523310:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503764480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.523336:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503764480:12345-0@lo:400:kworker.0 Request processed in 26us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787420.523341:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787420.525257:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765120 00000100:00100000:0.0:1787787420.525271:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765120 00000100:00100000:0.0:1787787420.525296:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503764992 00000100:00100000:0.0:1787787420.525299:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503764992 00000100:00100000:0.0:1787787420.525316:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787420.525326:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503764864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.525408:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503764864:12345-0@lo:400:kworker.0 Request processed in 83us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.525415:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787420.525758:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787420.525779:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503764224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.525810:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503764224:12345-0@lo:400:kworker.0 Request processed in 33us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.525816:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787420.525825:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787420.525831:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503764736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.525880:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503764736:12345-0@lo:400:kworker.0 Request processed in 49us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.526170:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787420.526190:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787420.526197:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503765248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.526228:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503765248:12345-0@lo:400:kworker.0 Request processed in 33us (4481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.526245:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787420.526256:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787420.526261:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.526288:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503765120:12345-0@lo:400:kworker.0 Request processed in 27us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.526292:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787420.526301:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787420.526307:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.526330:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503764992:12345-0@lo:400:kworker.0 Request processed in 24us (4126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787420.526335:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787420.526362:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503763712 00000100:00100000:0.0:1787787420.526374:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503763712 00000100:00100000:2.0:1787787420.526671:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787787420.526680:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3656:x1874630503763712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.526715:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3656:x1874630503763712:12345-0@lo:400:kworker.0 Request processed in 37us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787420.526720:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1787787420.527171:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787420.527177:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787420.527180:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787420.527182:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787420.527387:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787420.527568:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4171a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503765376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787420.527596:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503765632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787420.527628:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.527667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787420.527708:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503763968:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.527721:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503764480:0@lo:400:kworker.0 00010000:00080000:0.0:1787787420.527734:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc400da40 x1874630503764992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787420.527745:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503765504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787420.527746:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503764992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.527762:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503764096:0@lo:400:kworker.0 00000100:00100000:0.0:1787787420.527774:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503764608:0@lo:400:kworker.0 00000100:00100000:3.0:1787787420.527782:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787787420.527788:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc400f0c0 x1874630503765120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787420.527797:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503765120:0@lo:400:kworker.0 00000100:00100000:3.0:1787787420.527817:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765376 00000100:00100000:3.0:1787787420.527823:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765376 00000100:00100000:3.0:1787787420.527851:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765632 00000100:00100000:3.0:1787787420.527854:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765632 00000100:00100000:3.0:1787787420.527862:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765504 00000100:00100000:3.0:1787787420.527865:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765504 00000100:00100000:3.0:1787787420.527876:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787420.527883:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503765376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787420.527906:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787420.527942:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503765376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787420.527949:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787420.527962:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787420.527968:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503765632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787420.527981:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787420.528008:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503765632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787420.528014:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787420.528025:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787420.528030:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503765504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787420.528038:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787420.528061:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503765504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787420.528076:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787420.528109:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503765504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787420.528592:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4171a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503765376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787420.528620:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503763712:0@lo:400:kworker.0 00010000:00080000:2.0:1787787420.528633:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327cf00 x1874630503764224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787420.528659:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503764224:0@lo:400:kworker.0 00010000:00080000:2.0:1787787420.528673:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870c327c3c0 x1874630503764736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787420.528680:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503764736:0@lo:400:kworker.0 00010000:00080000:2.0:1787787420.528691:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41ccb40 x1874630503765248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787420.528698:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503765248:0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.528709:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503763840:0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.528721:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503764352:0@lo:400:kworker.0 00010000:00080000:2.0:1787787420.528732:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e612c0 x1874630503764864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787420.528740:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503764864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787420.529211:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503765632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787787421.420437:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787787421.479301:0:19829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:0.0:1787787421.551925:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1787787422.443174:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787787422.533598:0:19882:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787422.533967:0:19882:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787787422.570415:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503765760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787422.570494:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787422.570585:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765760 00000100:00100000:2.0:1787787422.570594:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765760 00000100:00100000:2.0:1787787422.570670:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787422.570679:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503765760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787422.570705:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787787422.570749:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503765760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787422.570887:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787787422.570943:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787422.570977:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503765760:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1787787423.346056:0:19932:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787423.346350:0:19932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787423.466284:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787423.594972:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787423.595000:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503766016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787423.595071:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787423.595132:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766016 00000100:00100000:2.0:1787787423.595156:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766016 00000100:00100000:2.0:1787787423.595217:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787423.595226:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503766016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787423.595264:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787787423.595310:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503766016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787423.595316:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787423.595364:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503766016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787423.595512:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787423.595524:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503765888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787423.595555:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787423.596543:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503765888 00000100:00100000:2.0:1787787423.596551:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503765888 00000100:00100000:2.0:1787787423.596608:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787423.596617:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503765888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787423.596644:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787423.596706:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503765888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787423.596714:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787423.596860:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503765888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787423.642927:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.643014:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806144 00000100:00100000:0.0:1787787423.643024:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806144 00000100:00100000:0.0:1787787423.643069:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:0.0:1787787423.643076:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1874630484806144:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787787423.643111:0:17146:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 66978c8d-7aad-4ae0-adce-30a3922603d6@192.168.204.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:0.0:1787787423.643197:0:17146:0:(genops.c:1385:class_connect()) connect: client 66978c8d-7aad-4ae0-adce-30a3922603d6, cookie 0x11620bc3f30aa2ff 00000100:00080000:0.0:1787787423.643346:0:17146:0:(import.c:65:import_set_state_nolock()) ffff986fc4389000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787423.643407:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+5:2390:x1874630484806144:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 329us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.643414:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:3.0:1787787423.652001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.653044:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806272 00000100:00100000:0.0:1787787423.653057:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806272 00000100:00100000:0.0:1787787423.653135:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:0.0:1787787423.653196:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+5:14880:x1874630484806272:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787423.653213:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787423.653241:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30aa306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c84d0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.653272:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30aa306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84d0 expref: 6 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.653295:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30aa306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84d0 expref: 6 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.653304:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15c00, rc 0) 00000100:00100000:0.0:1787787423.653374:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+6:14880:x1874630484806272:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 181us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.653382:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:3.0:1787787423.658110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.658261:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806400 00000100:00100000:1.0:1787787423.658272:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806400 00000100:00100000:1.0:1787787423.658330:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:1.0:1787787423.658339:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+6:14880:x1874630484806400:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787423.658471:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+6:14880:x1874630484806400:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 132us (371us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787423.658479:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:3.0:1787787423.660490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.660642:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806528 00000100:00100000:1.0:1787787423.660652:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806528 00000100:00100000:1.0:1787787423.660710:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:1.0:1787787423.660719:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+6:14880:x1874630484806528:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787423.660749:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787423.660767:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aa30d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c84d7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787423.660797:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aa30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84d7 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787423.660810:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aa30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84d7 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787423.660820:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5e00, rc 0) 00000100:00100000:1.0:1787787423.660876:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+7:14880:x1874630484806528:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 158us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787423.660884:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:3.0:1787787423.666351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.666472:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806656 00000100:00100000:0.0:1787787423.666483:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806656 00000100:00100000:0.0:1787787423.666548:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:0.0:1787787423.666558:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+7:14880:x1874630484806656:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787423.666741:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14880:x1874630484806656:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 184us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.666750:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:3.0:1787787423.668776:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787423.668938:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806784 00000100:00100000:2.0:1787787423.668947:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806784 00000100:00100000:2.0:1787787423.669001:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:2.0:1787787423.669011:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14880:x1874630484806784:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787787423.669194:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14880:x1874630484806784:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 184us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787423.669212:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:3.0:1787787423.675898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.676242:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484806912 00000100:00100000:1.0:1787787423.676258:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484806912 00000100:00100000:1.0:1787787423.676331:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:1.0:1787787423.676341:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14898:x1874630484806912:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787423.676519:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14898:x1874630484806912:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 179us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787423.676535:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:3.0:1787787423.712838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.716499:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807040 00000100:00100000:0.0:1787787423.716518:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807040 00000100:00100000:0.0:1787787423.716908:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:0.0:1787787423.716920:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14898:x1874630484807040:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787423.717842:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14898:x1874630484807040:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 918us (5013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.717853:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:3.0:1787787423.720372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.721572:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807168 00000100:00100000:1.0:1787787423.721587:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807168 00000100:00100000:1.0:1787787423.721654:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:1.0:1787787423.721664:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14898:x1874630484807168:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787423.721826:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14898:x1874630484807168:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 162us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787423.721840:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 123 00000040:00080000:1.0:1787787423.726117:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787787423.728743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.728906:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807296 00000100:00100000:0.0:1787787423.728917:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807296 00000100:00100000:0.0:1787787423.728983:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:0.0:1787787423.728992:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+8:14880:x1874630484807296:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787423.729009:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787423.729026:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15e00/0x11620bc3f30aa314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8508 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.729078:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15e00/0x11620bc3f30aa314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8508 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.730330:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15e00/0x11620bc3f30aa314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8508 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.730341:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15e00, rc 0) 00000100:00100000:0.0:1787787423.730411:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+9:14880:x1874630484807296:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 1420us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.730432:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:3.0:1787787423.738267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.741133:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807424 00000100:00100000:0.0:1787787423.741201:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807424 00000100:00100000:0.0:1787787423.741288:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:0.0:1787787423.741298:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+9:14880:x1874630484807424:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787787423.741341:0:17146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787787423.741374:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787787423.741379:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787787423.741382:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787787423.741386:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787787423.741388:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787787423.748009:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+9:14880:x1874630484807424:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 6701us (9741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.748025:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:3.0:1787787423.752568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.752879:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807552 00000100:00100000:0.0:1787787423.752889:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807552 00000100:00100000:0.0:1787787423.752948:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:0.0:1787787423.752960:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+9:14880:x1874630484807552:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787423.752980:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787423.752999:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c850f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.753030:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.753041:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787423.753065:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15400, rc 0) 00000100:00100000:0.0:1787787423.753346:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14880:x1874630484807552:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 387us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.753355:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:2.0:1787787423.759092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.759188:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807680 00000100:00100000:0.0:1787787423.759198:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807680 00000100:00100000:0.0:1787787423.759250:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:0.0:1787787423.759260:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14880:x1874630484807680:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787423.760025:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14880:x1874630484807680:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 762us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.760036:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:3.0:1787787423.768946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.774849:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807808 00000100:00100000:0.0:1787787423.774864:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807808 00000100:00100000:0.0:1787787423.774974:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:0.0:1787787423.774985:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14880:x1874630484807808:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787787423.775161:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14880:x1874630484807808:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 177us (6224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.775179:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:1.0:1787787423.782206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.782388:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484807936 00000100:00100000:0.0:1787787423.782399:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484807936 00000100:00100000:0.0:1787787423.782458:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00100000:0.0:1787787423.782467:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14902:x1874630484807936:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787423.782642:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14902:x1874630484807936:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 175us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.782659:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 129 00000100:00100000:1.0:1787787423.792128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.792325:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808064 00000100:00100000:0.0:1787787423.792336:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808064 00000100:00100000:0.0:1787787423.792401:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:0.0:1787787423.792412:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14902:x1874630484808064:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787423.792574:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+10:14902:x1874630484808064:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 156us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.792583:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:3.0:1787787423.802407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.806634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.810199:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808192 00000100:00100000:0.0:1787787423.810218:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808192 00000100:00100000:2.0:1787787423.811224:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808448 00000100:00100000:2.0:1787787423.811233:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808448 00000100:00100000:2.0:1787787423.811294:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787423.811303:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1874630484808448:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787787423.811338:0:18576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 06eed6ec-d774-46ad-afc7-a8fd1799d109@192.168.204.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:2.0:1787787423.811389:0:18576:0:(genops.c:1385:class_connect()) connect: client 06eed6ec-d774-46ad-afc7-a8fd1799d109, cookie 0x11620bc3f30aa322 00000004:00100000:2.0:1787787423.811412:0:18576:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787423.811851:0:18576:0:(import.c:65:import_set_state_nolock()) ffff986fc2760000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787423.811978:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2390:x1874630484808448:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 674us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787423.811987:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787423.812030:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:2.0:1787787423.812035:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1874630484808192:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787787423.812048:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 06eed6ec-d774-46ad-afc7-a8fd1799d109@192.168.204.31@tcp t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:2.0:1787787423.812108:0:17153:0:(genops.c:1385:class_connect()) connect: client 06eed6ec-d774-46ad-afc7-a8fd1799d109, cookie 0x11620bc3f30aa329 00000004:00100000:2.0:1787787423.812122:0:17153:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787423.813510:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9870f0374000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787423.813842:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2390:x1874630484808192:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1804us (11447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787423.813853:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:3.0:1787787423.819690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787423.819731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787423.819841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.823946:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808576 00000100:00100000:1.0:1787787423.823961:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808576 00000100:00100000:0.0:1787787423.826237:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808320 00000100:00100000:0.0:1787787423.826252:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808320 00000100:00100000:0.0:1787787423.826350:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808704 00000100:00100000:0.0:1787787423.826354:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808704 00000100:00100000:0.0:1787787423.826374:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:0.0:1787787423.826384:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:0:x1874630484808320:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787423.826422:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:3.0:1787787423.826639:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787423.826835:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:0:x1874630484808320:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 450us (7101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.826843:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:0.0:1787787423.826863:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787423.826871:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484808704:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787423.826883:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787787423.826907:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484808704:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 37us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.826929:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787423.826973:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:0.0:1787787423.826979:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:0:x1874630484808576:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787423.827000:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787423.827036:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:0:x1874630484808576:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 56us (7370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.827042:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00080000:3.0:1787787423.827103:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787423.830051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.833693:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808832 00000100:00100000:0.0:1787787423.833709:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808832 00000100:00100000:2.0:1787787423.835086:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787423.835099:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484808832:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787787423.835267:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484808832:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 170us (5227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787423.835276:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:3.0:1787787423.843960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787423.844005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787423.844105:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809216 00000100:00100000:1.0:1787787423.844116:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809216 00000100:00100000:1.0:1787787423.844223:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:1.0:1787787423.844234:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484809216:12345-192.168.204.31@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787787423.844322:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484809216:12345-192.168.204.31@tcp:900:mount.lustre.0 Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787423.844330:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1787787423.847560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787423.847901:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484808960 00000100:00100000:0.0:1787787423.847912:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484808960 00000100:00100000:0.0:1787787423.847953:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809088 00000100:00100000:0.0:1787787423.847957:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809088 00000100:00100000:0.0:1787787423.847988:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787423.847998:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1874630484808960:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787787423.848039:0:18656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 06eed6ec-d774-46ad-afc7-a8fd1799d109@192.168.204.31@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1787787423.848073:0:18656:0:(genops.c:1385:class_connect()) connect: client 06eed6ec-d774-46ad-afc7-a8fd1799d109, cookie 0x11620bc3f30aa330 00002000:00100000:0.0:1787787423.848103:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 06eed6ec-d774-46ad-afc7-a8fd1799d109/ffff9870c451c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787787423.848125:0:18656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787787423.848348:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787787423.848380:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9870c451d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787423.848457:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2390:x1874630484808960:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 459us (4449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.848466:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787423.848485:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:0.0:1787787423.848504:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1874630484809088:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787787423.848521:0:18656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 06eed6ec-d774-46ad-afc7-a8fd1799d109@192.168.204.31@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1787787423.848538:0:18656:0:(genops.c:1385:class_connect()) connect: client 06eed6ec-d774-46ad-afc7-a8fd1799d109, cookie 0x11620bc3f30aa337 00002000:00100000:0.0:1787787423.848543:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 06eed6ec-d774-46ad-afc7-a8fd1799d109/ffff9870c451a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787787423.848554:0:18656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787787423.848931:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787787423.848950:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9870c451c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787423.848977:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2390:x1874630484809088:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 472us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787423.848985:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:1.0:1787787423.860428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787423.860698:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809344 00000100:00100000:2.0:1787787423.860708:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809344 00000100:00100000:2.0:1787787423.860764:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:2.0:1787787423.860774:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484809344:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787787423.862763:0:17155:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1901us 00000004:00200000:1.0:1787787423.883462:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787787423.883622:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14880:x1874630484809344:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 22843us (23198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787423.883637:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:1.0:1787787424.139378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787424.139597:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809472 00000100:00100000:0.0:1787787424.139608:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809472 00000100:00100000:0.0:1787787424.139681:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:0.0:1787787424.139692:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14924:x1874630484809472:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:0.0:1787787424.139714:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787424.139777:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa33e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8540 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787424.140034:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aa345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787424.140052:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aa345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787424.140069:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aa345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787424.140212:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787424.140217:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787424.140293:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aa345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787424.140323:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa33e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8540 expref: 8 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787424.140344:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aa345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8540 expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787424.140353:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:0.0:1787787424.140356:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787424.140359:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031200, rc 0) 00000100:00100000:0.0:1787787424.140436:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:14924:x1874630484809472:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 746us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787424.140443:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00010000:00010000:0.0:1787787424.489474:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787424.618124:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787425.514359:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787425.641541:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787425.641565:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503766144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787425.641643:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787425.641731:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766144 00000100:00100000:0.0:1787787425.641739:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766144 00000100:00100000:0.0:1787787425.641799:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787425.641807:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503766144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787425.641841:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787787425.641881:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503766144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787425.641904:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787425.641973:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503766144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787425.642292:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503766400:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642339:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787425.642366:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503766912:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642388:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787425.642411:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503767424:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642433:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787425.642449:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787787425.642455:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503766272:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642478:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787425.642497:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503766784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642534:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787425.642548:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503767296:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642568:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787425.642591:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766400 00000100:00100000:1.0:1787787425.642594:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766400 00000100:00100000:1.0:1787787425.642618:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766784 00000100:00100000:1.0:1787787425.642620:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766784 00000100:00100000:1.0:1787787425.642632:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787425.642638:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503766400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642678:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503766400:12345-0@lo:400:kworker.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787425.642685:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787425.642697:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787425.642703:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503766784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642728:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503766784:12345-0@lo:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787425.642734:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787425.642757:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503766784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.642767:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503766400:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643169:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503766656:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.643222:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503767168:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643242:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.643256:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d9645e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503767680:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643274:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.643286:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787787425.643292:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503766528:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.643340:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503767040:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643360:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.643374:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc10b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503767552:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643391:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.643412:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766912 00000100:00100000:2.0:1787787425.643416:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766912 00000100:00100000:2.0:1787787425.643455:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766528 00000100:00100000:2.0:1787787425.643458:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766528 00000100:00100000:2.0:1787787425.643472:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767040 00000100:00100000:2.0:1787787425.643475:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767040 00000100:00100000:2.0:1787787425.643488:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787425.643494:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503766912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643531:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503766912:12345-0@lo:400:kworker.0 Request processed in 36us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.643538:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787425.643552:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787425.643557:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503766528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643585:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503766528:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.643591:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787425.643601:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787425.643606:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503767040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643629:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503767040:12345-0@lo:400:kworker.0 Request processed in 23us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.643635:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787425.643650:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767424 00000100:00100000:2.0:1787787425.643653:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767424 00000100:00100000:2.0:1787787425.643671:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767296 00000100:00100000:2.0:1787787425.643674:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767296 00000100:00100000:2.0:1787787425.643684:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766656 00000100:00100000:2.0:1787787425.643686:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766656 00000100:00100000:2.0:1787787425.643694:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767168 00000100:00100000:2.0:1787787425.643696:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767168 00000100:00100000:2.0:1787787425.643705:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767680 00000100:00100000:2.0:1787787425.643707:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767680 00000100:00100000:2.0:1787787425.643731:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767552 00000100:00100000:2.0:1787787425.643733:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767552 00000100:00100000:2.0:1787787425.643746:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787425.643752:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9646580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503767424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.643783:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9646580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503767424:12345-0@lo:400:kworker.0 Request processed in 32us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.643789:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787425.643800:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787425.643805:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9645680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503767296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.643986:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787425.644088:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9645680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503767296:12345-0@lo:400:kworker.0 Request processed in 282us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.644096:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787425.644109:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787425.644115:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503767168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644173:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503767168:12345-0@lo:400:kworker.0 Request processed in 58us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.644179:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787425.644190:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787425.644196:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503767680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644221:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503767680:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.644227:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787425.644237:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787425.644243:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503767552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644266:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503767552:12345-0@lo:400:kworker.0 Request processed in 23us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.644278:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787425.644309:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787787425.644419:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503766656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.644452:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503766656:12345-0@lo:400:kworker.0 Request processed in 460us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787425.644459:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787787425.644501:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503767296:0@lo:400:kworker.0 00000100:00100000:1.0:1787787425.644512:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503766912:0@lo:400:kworker.0 00010000:00080000:1.0:1787787425.644523:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc10b3c00 x1874630503767424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787425.644534:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503767424:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644890:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503766528:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644910:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503767040:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644921:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503767552:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644931:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503766656:0@lo:400:kworker.0 00000100:00100000:2.0:1787787425.644941:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503767168:0@lo:400:kworker.0 00010000:00080000:2.0:1787787425.644951:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d9645e00 x1874630503767680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787425.644961:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d9645e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503767680:0@lo:400:kworker.0 00000100:00080000:3.0:1787787425.645280:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787425.645286:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787425.645290:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787425.645293:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787425.645319:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787425.645346:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503767808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787425.645394:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787425.645688:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767808 00000100:00100000:0.0:1787787425.645705:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767808 00000100:00100000:0.0:1787787425.645752:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787425.645761:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503767808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787425.645778:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787425.645829:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503767808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787425.645836:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787425.645870:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503766272 00000100:00100000:0.0:1787787425.645874:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503766272 00000100:00100000:0.0:1787787425.645898:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787787425.645904:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3656:x1874630503766272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787425.645957:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3656:x1874630503766272:12345-0@lo:400:kworker.0 Request processed in 53us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787425.645965:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787787425.646269:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503767808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787425.646281:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc10b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503766272:0@lo:400:kworker.0 00000100:00100000:3.0:1787787425.646570:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503767936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787425.646607:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787425.646821:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503767936 00000100:00100000:2.0:1787787425.646827:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503767936 00000100:00100000:2.0:1787787425.646862:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787425.646870:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503767936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787787425.646884:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787787425.646931:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503767936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787425.646938:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787425.647189:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503767936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787426.258549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787426.258796:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809600 00000100:00100000:3.0:1787787426.258807:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809600 00000100:00100000:3.0:1787787426.258889:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:3.0:1787787426.258898:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:14977:x1874630484809600:12345-192.168.204.31@tcp:41:lfs.0 00000004:00000024:3.0:1787787426.258939:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787787426.259039:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:14977:x1874630484809600:12345-192.168.204.31@tcp:41:lfs.0 Request processed in 141us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787426.259047:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00080000:0.0:1787787426.259127:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787426.266238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.266704:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809728 00000100:00100000:0.0:1787787426.266714:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809728 00000100:00100000:0.0:1787787426.266797:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:0.0:1787787426.266807:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14977:x1874630484809728:12345-192.168.204.31@tcp:41:lfs.0 00000004:00000024:0.0:1787787426.266842:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787426.266938:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14977:x1874630484809728:12345-192.168.204.31@tcp:41:lfs.0 Request processed in 132us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.266964:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00080000:3.0:1787787426.267077:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787426.272053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.272182:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809856 00000100:00100000:0.0:1787787426.272194:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809856 00000100:00080000:3.0:1787787426.272342:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787426.272992:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:0.0:1787787426.273007:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14977:x1874630484809856:12345-192.168.204.31@tcp:13:lfs.0 00002000:00000024:0.0:1787787426.273038:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787787426.273212:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14977:x1874630484809856:12345-192.168.204.31@tcp:13:lfs.0 Request processed in 210us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.273220:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:2.0:1787787426.275961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787426.277745:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484809984 00000100:00100000:1.0:1787787426.277760:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484809984 00000100:00100000:1.0:1787787426.277901:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:1.0:1787787426.277911:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14977:x1874630484809984:12345-192.168.204.31@tcp:13:lfs.0 00002000:00000024:1.0:1787787426.277946:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1787787426.277982:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787426.278088:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:14977:x1874630484809984:12345-192.168.204.31@tcp:13:lfs.0 Request processed in 178us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787426.278096:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:2.0:1787787426.459393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787426.463341:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810112 00000100:00100000:3.0:1787787426.463366:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810112 00000100:00100000:3.0:1787787426.463553:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:3.0:1787787426.463565:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+10:15010:x1874630484810112:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787426.463585:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787426.463608:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c7000/0x11620bc3f30aa34c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8547 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787426.463647:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c7000/0x11620bc3f30aa34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8547 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787426.463660:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c7000/0x11620bc3f30aa34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8547 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787426.463671:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7000, rc 0) 00000100:00100000:3.0:1787787426.463766:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15010:x1874630484810112:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 203us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787426.463774:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:2.0:1787787426.469628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.470344:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810240 00000100:00100000:0.0:1787787426.470360:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810240 00000100:00100000:0.0:1787787426.470453:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:0.0:1787787426.470465:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15010:x1874630484810240:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787426.470689:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15010:x1874630484810240:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 225us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.470699:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:1.0:1787787426.473672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.473792:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810368 00000100:00100000:2.0:1787787426.473828:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810368 00000100:00100000:2.0:1787787426.473901:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:2.0:1787787426.473913:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15010:x1874630484810368:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787787426.474112:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15010:x1874630484810368:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 199us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.474134:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:1.0:1787787426.478868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.479348:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810496 00000100:00100000:2.0:1787787426.479361:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810496 00000100:00100000:2.0:1787787426.479440:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:2.0:1787787426.479453:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15016:x1874630484810496:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787426.481082:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15016:x1874630484810496:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 1614us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.481099:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:1.0:1787787426.511484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787426.511590:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810624 00000100:00100000:3.0:1787787426.511602:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810624 00000100:00100000:3.0:1787787426.511677:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:3.0:1787787426.511689:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15016:x1874630484810624:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787426.511911:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15016:x1874630484810624:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 223us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787426.511921:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:1.0:1787787426.523034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.523695:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810752 00000100:00100000:2.0:1787787426.523711:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810752 00000100:00100000:2.0:1787787426.523796:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:2.0:1787787426.523808:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15016:x1874630484810752:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787426.524037:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15016:x1874630484810752:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 230us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.524047:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:1.0:1787787426.531486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.531624:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484810880 00000100:00100000:0.0:1787787426.531637:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484810880 00000100:00100000:0.0:1787787426.531767:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:0.0:1787787426.531780:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+11:15010:x1874630484810880:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787426.531802:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787426.531827:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0030800/0x11620bc3f30aa353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8578 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.531869:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0030800/0x11620bc3f30aa353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8578 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.531903:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0030800/0x11620bc3f30aa353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8578 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.531914:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030800, rc 0) 00000100:00100000:0.0:1787787426.531998:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+12:15010:x1874630484810880:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 220us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.532007:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:1.0:1787787426.534802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787426.534977:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811008 00000100:00100000:3.0:1787787426.535005:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811008 00000100:00100000:3.0:1787787426.535075:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 139 00000100:00100000:3.0:1787787426.535086:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+12:15010:x1874630484811008:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787787426.535162:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787787426.535195:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787787426.535200:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787787426.535203:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787787426.535207:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787787426.535209:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00010000:00010000:0.0:1787787426.538559:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787426.539828:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+12:15010:x1874630484811008:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 4730us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787426.539844:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 139 00000100:00100000:1.0:1787787426.542933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.543057:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811136 00000100:00100000:0.0:1787787426.543070:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811136 00000100:00100000:0.0:1787787426.543329:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 140 00000100:00100000:0.0:1787787426.543341:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+12:15010:x1874630484811136:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787426.543365:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787426.543389:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c857f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.543428:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.543443:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.543454:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:0.0:1787787426.543572:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15010:x1874630484811136:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 233us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.543580:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 140 00000100:00100000:1.0:1787787426.546883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.547039:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811264 00000100:00100000:0.0:1787787426.547051:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811264 00000100:00100000:0.0:1787787426.547153:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 141 00000100:00100000:0.0:1787787426.547171:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15010:x1874630484811264:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787426.547351:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15010:x1874630484811264:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 188us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.547359:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 141 00000100:00100000:1.0:1787787426.549641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.549721:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811392 00000100:00100000:0.0:1787787426.549734:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811392 00000100:00100000:0.0:1787787426.549846:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:0.0:1787787426.549858:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15010:x1874630484811392:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787787426.550037:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15010:x1874630484811392:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 180us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.550045:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:1.0:1787787426.552543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.553509:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811520 00000100:00100000:2.0:1787787426.553525:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811520 00000100:00100000:2.0:1787787426.553589:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 143 00000100:00100000:2.0:1787787426.553600:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15020:x1874630484811520:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787426.553818:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15020:x1874630484811520:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 217us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.553836:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 143 00000100:00100000:1.0:1787787426.556085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.558404:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811648 00000100:00100000:2.0:1787787426.558429:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811648 00000100:00100000:2.0:1787787426.558541:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 144 00000100:00100000:2.0:1787787426.558554:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15020:x1874630484811648:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787426.559282:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:15020:x1874630484811648:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 725us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.559295:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 144 00000100:00100000:1.0:1787787426.570951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787426.571000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.571395:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811776 00000100:00100000:2.0:1787787426.571409:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811776 00000100:00100000:2.0:1787787426.571463:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812032 00000100:00100000:2.0:1787787426.571467:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812032 00000100:00100000:2.0:1787787426.571490:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1787787426.571500:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1874630484811776:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787787426.571542:0:18576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 72f0a557-2c5a-424e-9fbb-a30d283f0eb0@192.168.204.31@tcp t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:2.0:1787787426.571590:0:18576:0:(genops.c:1385:class_connect()) connect: client 72f0a557-2c5a-424e-9fbb-a30d283f0eb0, cookie 0x11620bc3f30aa361 00000004:00100000:2.0:1787787426.571627:0:18576:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787426.571761:0:18576:0:(import.c:65:import_set_state_nolock()) ffff9870f0371000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787426.571851:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9646d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2390:x1874630484811776:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 350us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.571859:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1787787426.571882:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:2.0:1787787426.571887:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1874630484812032:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787787426.571904:0:18576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 72f0a557-2c5a-424e-9fbb-a30d283f0eb0@192.168.204.31@tcp t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:2.0:1787787426.571979:0:18576:0:(genops.c:1385:class_connect()) connect: client 72f0a557-2c5a-424e-9fbb-a30d283f0eb0, cookie 0x11620bc3f30aa368 00000004:00100000:2.0:1787787426.571996:0:18576:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787426.572045:0:18576:0:(import.c:65:import_set_state_nolock()) ffff9870f0376000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787426.572071:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2390:x1874630484812032:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 182us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.572078:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:2.0:1787787426.578431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.578556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.585903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787426.589879:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812160 00000100:00100000:1.0:1787787426.589904:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812160 00000100:00100000:1.0:1787787426.590027:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484811904 00000100:00100000:1.0:1787787426.590030:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484811904 00000100:00100000:1.0:1787787426.590068:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:1.0:1787787426.590081:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:0:x1874630484812160:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00080000:0.0:1787787426.590363:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787426.590369:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787426.590412:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:0.0:1787787426.590424:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:0:x1874630484811904:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787426.590451:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787787426.590561:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:0:x1874630484811904:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 140us (12004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.590569:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000004:00000024:1.0:1787787426.591332:0:18576:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787426.591402:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:0:x1874630484812160:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 1320us (12986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787426.591412:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:3.0:1787787426.592821:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812288 00000100:00100000:3.0:1787787426.592837:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812288 00000100:00100000:0.0:1787787426.593740:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787426.593763:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812288:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787426.593801:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787787426.593932:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812288:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 179us (8700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.593941:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787426.598505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787426.598616:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812416 00000100:00100000:1.0:1787787426.598630:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812416 00000100:00100000:1.0:1787787426.598703:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1787787426.598714:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812416:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787787426.598832:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812416:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787426.598862:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1787787426.602498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787426.602602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787426.602642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787426.602814:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812544 00000100:00100000:2.0:1787787426.602828:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812544 00000100:00100000:2.0:1787787426.602885:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812672 00000100:00100000:2.0:1787787426.602889:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812672 00000100:00100000:2.0:1787787426.602913:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:2.0:1787787426.602925:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1874630484812544:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787426.602973:0:18658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 72f0a557-2c5a-424e-9fbb-a30d283f0eb0@192.168.204.31@tcp t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:2.0:1787787426.603016:0:18658:0:(genops.c:1385:class_connect()) connect: client 72f0a557-2c5a-424e-9fbb-a30d283f0eb0, cookie 0x11620bc3f30aa36f 00002000:00100000:2.0:1787787426.603031:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 72f0a557-2c5a-424e-9fbb-a30d283f0eb0/ffff9870f0373000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787426.603045:0:18658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787426.603300:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787787426.603341:0:18658:0:(import.c:65:import_set_state_nolock()) ffff9870f0372000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787426.603423:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2390:x1874630484812544:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 499us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.603433:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:2.0:1787787426.603458:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1787787426.603463:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1874630484812672:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787426.603500:0:18658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 72f0a557-2c5a-424e-9fbb-a30d283f0eb0@192.168.204.31@tcp t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:2.0:1787787426.603520:0:18658:0:(genops.c:1385:class_connect()) connect: client 72f0a557-2c5a-424e-9fbb-a30d283f0eb0, cookie 0x11620bc3f30aa376 00002000:00100000:2.0:1787787426.603526:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 72f0a557-2c5a-424e-9fbb-a30d283f0eb0/ffff9870f0376800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787426.603533:0:18658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787426.603582:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787426.603598:0:18658:0:(import.c:65:import_set_state_nolock()) ffff9870f0370800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787426.603623:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2390:x1874630484812672:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 159us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787426.603630:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1787787426.613040:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812800 00000100:00100000:3.0:1787787426.613063:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812800 00000100:00100000:0.0:1787787426.613560:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:0.0:1787787426.613574:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812800:12345-192.168.204.31@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787787426.613702:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812800:12345-192.168.204.31@tcp:900:mount.lustre.0 Request processed in 131us (11221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.613712:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:1.0:1787787426.616342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787426.616581:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484812928 00000100:00100000:3.0:1787787426.616595:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484812928 00000100:00100000:3.0:1787787426.616656:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1787787426.616667:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812928:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787787426.616789:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787787426.616899:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15010:x1874630484812928:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 233us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787426.616908:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1787787426.827285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787426.827483:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813056 00000100:00100000:0.0:1787787426.827495:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813056 00000100:00100000:0.0:1787787426.827573:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787426.827584:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9645e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15043:x1874630484813056:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:0.0:1787787426.827610:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787426.827639:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aa37d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85b0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.827727:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.827746:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.827763:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787426.827818:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787426.827822:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787426.827869:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.827904:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aa37d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.827927:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787426.827937:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:0.0:1787787426.827941:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787426.827945:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:0.0:1787787426.828028:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9645e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+7:15043:x1874630484813056:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 444us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787426.828037:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00010000:00010000:1.0:1787787427.570480:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787427.689434:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787427.689458:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503768064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787427.689531:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787427.689745:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768064 00000100:00100000:2.0:1787787427.689755:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768064 00000100:00100000:2.0:1787787427.689836:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787427.689846:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503768064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787427.689872:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787787427.689928:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503768064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787427.689936:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787427.689973:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503768064:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787787427.690618:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787787428.588032:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787428.718133:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787428.718182:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503768192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787428.718253:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787428.718436:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503768320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787428.718466:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787428.718538:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768192 00000100:00100000:0.0:1787787428.718545:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768192 00000100:00100000:0.0:1787787428.718585:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768320 00000100:00100000:0.0:1787787428.718588:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768320 00000100:00100000:0.0:1787787428.718602:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787428.718610:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503768192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787428.718642:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787428.718695:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503768192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787428.718703:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787428.718720:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787428.718725:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503768320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787428.718748:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787787428.718779:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503768320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787428.718785:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787428.718819:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503768320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787428.718895:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503768192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787787429.616789:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787429.745458:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:1.0:1787787429.745471:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:00100000:1.0:1787787429.747443:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:1.0:1787787429.747456:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:00100000:2.0:1787787429.749394:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:2.0:1787787429.749407:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:00100000:0.0:1787787429.751334:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:0.0:1787787429.751351:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:02000400:0.0:1787787430.032671:0:20030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787787430.634333:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787430.761572:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503768576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787430.761659:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787430.762130:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787430.762182:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787430.762240:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768576 00000100:00100000:1.0:1787787430.762248:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768576 00000100:00100000:1.0:1787787430.762297:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768448 00000100:00100000:1.0:1787787430.762300:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768448 00000100:00100000:1.0:1787787430.762325:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787430.762333:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503768576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787430.762387:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787430.762442:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503768576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787430.762449:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787430.762469:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787430.762475:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503768448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787430.762491:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787787430.762520:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503768448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787430.762526:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787787430.762541:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787430.762546:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787430.762581:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787430.763487:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503769088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.763530:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.763562:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503769600:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.763583:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.763596:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503770112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787430.763617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.763646:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503768576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787430.763662:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787787430.763667:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503768704:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.763695:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.763715:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503769216:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.763734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.763764:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503769728:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.763795:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.763821:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769216 00000100:00100000:0.0:1787787430.763826:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769216 00000100:00100000:0.0:1787787430.763867:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787430.763874:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503769216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787430.764221:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769600 00000100:00100000:1.0:1787787430.764227:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769600 00000100:00100000:0.0:1787787430.764337:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503769216:12345-0@lo:400:kworker.0 Request processed in 461us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.764346:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787430.764369:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769728 00000100:00100000:0.0:1787787430.764372:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769728 00000100:00100000:0.0:1787787430.764398:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787430.764404:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764433:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503769728:12345-0@lo:400:kworker.0 Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.764438:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787430.764465:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503769216:0@lo:400:kworker.0 00010000:00080000:0.0:1787787430.764476:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b2d00 x1874630503769728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787430.764486:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503769728:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764524:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503768960:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764548:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.764566:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503769472:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764583:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.764597:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503769984:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764630:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.764647:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787787430.764654:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503768832:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.764691:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503769344:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.764722:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503769856:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764753:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787430.764773:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768960 00000100:00100000:0.0:1787787430.764776:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768960 00000100:00100000:3.0:1787787430.764834:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769088 00000100:00100000:3.0:1787787430.764839:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769088 00000100:00100000:1.0:1787787430.764884:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769472 00000100:00100000:1.0:1787787430.764887:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769472 00000100:00100000:0.0:1787787430.764924:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769984 00000100:00100000:0.0:1787787430.764927:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769984 00000100:00100000:0.0:1787787430.764941:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769856 00000100:00100000:0.0:1787787430.764943:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769856 00000100:00100000:0.0:1787787430.764955:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787787430.764961:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503769600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.764999:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503769600:12345-0@lo:400:kworker.0 Request processed in 37us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765004:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787787430.765016:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787430.765022:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503768960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765073:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503768960:12345-0@lo:400:kworker.0 Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765080:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787430.765092:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787430.765098:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503769984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765173:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503769984:12345-0@lo:400:kworker.0 Request processed in 75us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765180:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787430.765193:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787787430.765199:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765223:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503769856:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765235:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787787430.765277:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503769856:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765288:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503768960:0@lo:400:kworker.0 00010000:00080000:0.0:1787787430.765298:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b1a40 x1874630503769984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787430.765307:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503769984:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765333:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503769600:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765367:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768704 00000100:00100000:0.0:1787787430.765370:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768704 00000100:00100000:0.0:1787787430.765394:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787787430.765400:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503768704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765434:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503768704:12345-0@lo:400:kworker.0 Request processed in 34us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765440:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787787430.765466:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503770112 00000100:00100000:0.0:1787787430.765470:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503770112 00000100:00100000:0.0:1787787430.765496:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787430.765511:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503770112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787430.765540:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787430.765575:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503770112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765581:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787430.765604:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503768704:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765621:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503770112:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787787430.765645:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787430.765650:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787430.765651:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787430.765654:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787430.765667:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503769344 00000100:00100000:0.0:1787787430.765670:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503769344 00000100:00100000:0.0:1787787430.765695:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787430.765701:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503769344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765735:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503769344:12345-0@lo:400:kworker.0 Request processed in 34us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765741:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787430.765766:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503769344:0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765801:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503768832 00000100:00100000:0.0:1787787430.765805:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503768832 00000100:00100000:0.0:1787787430.765825:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787430.765831:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503768832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787430.765868:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503768832:12345-0@lo:400:kworker.0 Request processed in 37us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787430.765873:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787430.765906:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503768832:0@lo:400:kworker.0 00000100:00100000:3.0:1787787430.767769:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787430.767783:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503769088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787430.767884:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503769088:12345-0@lo:400:kworker.0 Request processed in 103us (4352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787430.767892:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787787430.768090:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503769088:0@lo:400:kworker.0 00000100:00100000:1.0:1787787430.768383:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787430.768393:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503769472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787430.768450:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503769472:12345-0@lo:400:kworker.0 Request processed in 58us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787430.768456:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787787430.768513:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503769472:0@lo:400:kworker.0 00010000:00010000:0.0:1787787431.658344:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787432.113294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787432.113518:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813184 00000100:00100000:1.0:1787787432.113528:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813184 00000100:00100000:1.0:1787787432.113579:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 146 00000100:00100000:1.0:1787787432.113589:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2393:x1874630484813184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.113658:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2393:x1874630484813184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.113667:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 146 00000100:00100000:1.0:1787787432.113698:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813440 00000100:00100000:1.0:1787787432.113701:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813440 00000100:00100000:1.0:1787787432.113729:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813952 00000100:00100000:1.0:1787787432.113732:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813952 00000100:00100000:1.0:1787787432.113743:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813312 00000100:00100000:1.0:1787787432.113746:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813312 00000100:00100000:1.0:1787787432.113756:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813824 00000100:00100000:1.0:1787787432.113758:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813824 00000100:00100000:1.0:1787787432.113770:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:1.0:1787787432.113776:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484813440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.113806:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484813440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.113813:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:1.0:1787787432.113825:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:1.0:1787787432.113830:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484813952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.113851:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484813952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.113870:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:1.0:1787787432.113883:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1787787432.113889:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2393:x1874630484813312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.113913:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2393:x1874630484813312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.113918:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1787787432.113929:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:1.0:1787787432.113934:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2393:x1874630484813824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.113956:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2393:x1874630484813824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.113962:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:1.0:1787787432.113979:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813696 00000100:00100000:1.0:1787787432.113983:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813696 00000100:00100000:1.0:1787787432.114018:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814208 00000100:00100000:1.0:1787787432.114021:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814208 00000100:00100000:1.0:1787787432.114034:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484813568 00000100:00100000:1.0:1787787432.114036:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484813568 00000100:00100000:1.0:1787787432.114047:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814080 00000100:00100000:1.0:1787787432.114049:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814080 00000100:00100000:1.0:1787787432.114072:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:1.0:1787787432.114078:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484813696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.114102:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484813696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.114108:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:1.0:1787787432.114119:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1787787432.114132:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484814208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.114182:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484814208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.114189:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1787787432.114201:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:1.0:1787787432.114207:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484813568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.114230:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484813568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.114235:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:1.0:1787787432.114245:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:1.0:1787787432.114250:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484814080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787432.114267:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484814080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 17us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787432.114272:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00080000:1.0:1787787432.114460:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787432.114464:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787432.114467:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787432.114469:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787787432.683266:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787432.809574:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503770240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787432.809643:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787432.809788:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503770240 00000100:00100000:3.0:1787787432.809795:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503770240 00000100:00100000:3.0:1787787432.809854:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787432.809863:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4171a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503770240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787432.809895:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787432.809939:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4171a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503770240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787432.809945:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787787432.810011:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787432.810052:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503770240:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787787433.706395:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787433.833858:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503770368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787433.833942:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787433.834016:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787433.834024:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503770496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787433.834049:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787433.834107:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503770368 00000100:00100000:3.0:1787787433.834115:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503770368 00000100:00100000:2.0:1787787433.834170:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503770496 00000100:00100000:2.0:1787787433.834177:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503770496 00000100:00100000:3.0:1787787433.834181:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787433.834192:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503770368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787433.834230:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787787433.834385:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503770368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787433.834393:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787433.834411:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787787433.834427:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503770496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787433.834445:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787787433.834485:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503770496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787433.834497:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787433.835874:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503770368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787433.835986:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503770496:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787787433.962960:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1787787434.007016:0:20177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf01272a0 20000000:00000080:2.0:1787787434.007043:0:20177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9870f03cc800 uarg=0000000000000000 20000000:01000000:2.0:1787787434.007084:0:20177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787787434.007091:0:20177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787787434.007095:0:20177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787787434.008693:0:20178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787787434.008843:0:20177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787787434.019482:0:20177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787787434.019513:0:20177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019537:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019545:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019553:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019560:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019569:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019576:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019597:0:20177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019641:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.019657:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 12 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.019672:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503770624:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787434.021465:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.021482:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.021495:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503770752:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787434.021558:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.021566:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 23 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.021575:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503770880:0@lo:104: 00000100:00100000:0.0:1787787434.021655:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787434.021698:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787434.022197:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503770880 00000100:00100000:3.0:1787787434.022207:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503770880 00000100:00100000:3.0:1787787434.022260:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787434.022270:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:20177:x1874630503770880:12345-0@lo:104: 00010000:00010000:3.0:1787787434.022283:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.022342:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787434.022348:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:20177:x1874630503770880:12345-0@lo:104: Request processed in 80us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787434.022355:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787787434.022380:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787434.022385:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.022393:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787434.022397:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.022405:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787434.022412:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787434.022418:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787434.022447:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.022463:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787434.022496:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.022504:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa107 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.022520:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787434.022522:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787434.022524:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787434.022787:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503771136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787434.022825:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787434.023856:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 23 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.023882:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503771008:0@lo:104: 00000100:00100000:0.0:1787787434.023929:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787434.023994:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.024006:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 23 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.024015:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503771264:0@lo:104: 00000100:00100000:0.0:1787787434.024049:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787434.024069:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.024077:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 23 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.024085:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503771392:0@lo:104: 00000100:00100000:0.0:1787787434.024102:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787434.024110:0:20177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1c94f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787434.024130:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503770880:0@lo:104: 00000100:00100000:2.0:1787787434.024264:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771008 00000100:00100000:2.0:1787787434.024271:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771008 00000100:00100000:2.0:1787787434.024311:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771264 00000100:00100000:2.0:1787787434.024314:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771264 00000100:00100000:2.0:1787787434.024323:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771392 00000100:00100000:2.0:1787787434.024325:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771392 00000100:00100000:2.0:1787787434.024337:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787434.024346:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+5:20177:x1874630503771008:12345-0@lo:104: 00010000:00010000:2.0:1787787434.024357:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024423:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787434.024430:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+5:20177:x1874630503771008:12345-0@lo:104: Request processed in 85us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787434.024438:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787434.024456:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787434.024462:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:20177:x1874630503771264:12345-0@lo:104: 00010000:00010000:2.0:1787787434.024469:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024499:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787787434.024503:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+4:20177:x1874630503771264:12345-0@lo:104: Request processed in 43us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787434.024509:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787434.024521:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787434.024526:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:20177:x1874630503771392:12345-0@lo:104: 00010000:00010000:2.0:1787787434.024533:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024556:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787787434.024561:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+3:20177:x1874630503771392:12345-0@lo:104: Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787434.024566:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787787434.024582:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787787434.024587:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024602:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787434.024607:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024614:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787434.024621:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787434.024627:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787434.024653:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024659:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787434.024676:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024683:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e1c00/0x11620bc3f30aa066 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa06d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024694:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787434.024697:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024703:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787434.024705:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024722:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787434.024729:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787434.024734:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787434.024747:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024753:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787434.024767:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024774:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa027 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa02e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024783:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787434.024786:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024791:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787434.024794:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024800:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787434.024806:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787434.024817:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787434.024830:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024836:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787434.024843:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024848:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f2e00/0x11620bc3f30aa019 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa020 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.024861:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787434.024863:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787434.024864:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787434.024876:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503771648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787434.024904:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787434.024925:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787434.024930:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503771776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787434.024949:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787434.024990:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771136 00000100:00100000:2.0:1787787434.024995:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771136 00010000:00010000:2.0:1787787434.025015:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 24 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787434.025035:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771648 00000100:00100000:2.0:1787787434.025037:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771648 00010000:00010000:2.0:1787787434.025046:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787434.025065:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771776 00000100:00100000:2.0:1787787434.025068:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771776 00010000:00010000:2.0:1787787434.025080:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 26 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787434.025090:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787434.025096:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+26:3653:x1874630503771136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787434.025104:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787434.025108:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 26 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.025116:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 26 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.025129:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f3600/0x11620bc3f30aa107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa100 expref: 26 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787434.025324:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503771008:0@lo:104: 00000100:00100000:0.0:1787787434.025333:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503771264:0@lo:104: 00000100:00100000:0.0:1787787434.025340:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503771392:0@lo:104: 00000100:00100000:3.0:1787787434.025437:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787434.025448:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+25:3655:x1874630503771648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787434.025456:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787434.025461:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.025471:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.025482:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e0c00/0x11620bc3f30aa02e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa027 expref: 25 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.025492:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787434.025529:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3655:x1874630503771648:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787434.025535:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787434.025551:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787434.025557:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:3655:x1874630503771776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787434.025572:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787434.025576:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 23 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.025585:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 23 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.025595:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1600/0x11620bc3f30aa020 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa019 expref: 23 pid: 17146 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.025604:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787434.025627:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3655:x1874630503771776:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787434.025632:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787787434.025667:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787434.025691:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3653:x1874630503771136:12345-0@lo:103:ldlm_bl.0 Request processed in 596us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787434.025698:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787434.025724:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503771520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787434.025748:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787434.025802:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503771776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787434.025809:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503771648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787434.025836:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503771136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787434.025860:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787434.027582:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771520 00000100:00100000:3.0:1787787434.027595:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771520 00010000:00010000:3.0:1787787434.027634:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 21 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787434.027671:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787434.027680:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3654:x1874630503771520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787434.027692:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787434.027698:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 21 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.027708:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 21 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.027727:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1a00/0x11620bc3f30aa06d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa066 expref: 21 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.027758:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787434.027824:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3654:x1874630503771520:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787434.027831:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787434.029499:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503771520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787434.039667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787434.040059:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503770624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787434.040092:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1874630503770752:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787434.040132:0:20177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787434.040716:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814336 00000100:00100000:2.0:1787787434.040725:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814336 00010000:00010000:2.0:1787787434.040772:0:18684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 13 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787434.040855:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:2.0:1787787434.040867:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5badc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2392:x1874630484814336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787434.040894:0:18684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787434.040901:0:18684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 13 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.040913:0:18684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 13 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.040930:0:18684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa35a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c857f expref: 13 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787434.040945:0:18684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787434.041022:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5badc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66978c8d-7aad-4ae0-adce-30a3922603d6+12:2392:x1874630484814336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 157us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787434.041030:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:0.0:1787787434.043379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787434.043493:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814464 00000100:00100000:3.0:1787787434.043505:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814464 00010000:00010000:3.0:1787787434.043546:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787434.043620:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:3.0:1787787434.043632:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66978c8d-7aad-4ae0-adce-30a3922603d6+12:2391:x1874630484814464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787434.043646:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787434.043651:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043664:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043681:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa31b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c850f expref: 12 pid: 17145 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043699:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043708:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043726:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043747:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043754:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043762:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043769:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787434.043773:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043783:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043804:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787434.043815:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787434.043916:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66978c8d-7aad-4ae0-adce-30a3922603d6+11:2391:x1874630484814464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 285us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787434.043925:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00010000:00010000:0.0:1787787434.044091:0:20177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.044100:0:20177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.044106:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0030600/0x11620bc3f30aa38b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787434.729665:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787434.857808:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787787435.371391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787435.371521:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814592 00000100:00100000:0.0:1787787435.371531:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814592 00000100:00100000:0.0:1787787435.371591:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 147 00000100:00100000:0.0:1787787435.371601:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:14894:x1874630484814592:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787435.371619:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787435.371650:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0031e00/0x11620bc3f30aa392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85b7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787435.371683:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0031e00/0x11620bc3f30aa392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b7 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787435.371694:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0031e00/0x11620bc3f30aa392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b7 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787435.371721:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031e00, rc 0) 00000100:00100000:0.0:1787787435.371776:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+12:14894:x1874630484814592:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 176us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787435.371783:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 147 00000100:00100000:0.0:1787787435.375435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787435.375511:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814720 00000100:00100000:3.0:1787787435.375521:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814720 00000100:00100000:3.0:1787787435.375576:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00100000:3.0:1787787435.375586:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+12:14894:x1874630484814720:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787435.375853:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+12:14894:x1874630484814720:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 267us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.375871:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 148 00000100:00100000:0.0:1787787435.380921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787435.381006:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814848 00000100:00100000:3.0:1787787435.381018:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814848 00000100:00100000:3.0:1787787435.381075:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 149 00000100:00100000:3.0:1787787435.381085:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+12:14894:x1874630484814848:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787435.381279:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+12:14894:x1874630484814848:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.381287:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 149 00000100:00100000:0.0:1787787435.416041:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787435.416075:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484814976 00000100:00100000:0.0:1787787435.416084:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484814976 00000100:00100000:0.0:1787787435.416292:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 150 00000100:00100000:0.0:1787787435.416302:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+12:14894:x1874630484814976:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787435.416319:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787435.416338:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85be expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787435.416367:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85be expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787435.416380:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85be expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787435.416389:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030e00, rc 0) 00000100:00100000:0.0:1787787435.416442:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:14894:x1874630484814976:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 141us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787435.416450:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 150 00000100:00100000:0.0:1787787435.418834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787435.418925:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815104 00000100:00100000:3.0:1787787435.418933:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815104 00000100:00100000:3.0:1787787435.418991:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 151 00000100:00100000:3.0:1787787435.419001:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:14894:x1874630484815104:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787435.419884:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:14894:x1874630484815104:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 879us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.419894:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 151 00000100:00100000:1.0:1787787435.424984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787435.427050:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815232 00000100:00100000:3.0:1787787435.427065:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815232 00000100:00100000:3.0:1787787435.427158:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 152 00000100:00100000:3.0:1787787435.427170:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+13:14894:x1874630484815232:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787435.427313:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+13:14894:x1874630484815232:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 145us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.427322:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 152 00010000:00010000:2.0:1787787435.754447:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787435.881487:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503771904:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.881586:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503772032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.881638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.881755:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772032 00000100:00100000:1.0:1787787435.881766:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772032 00000100:00100000:1.0:1787787435.881819:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787435.881846:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503772032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.881904:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503772032:12345-0@lo:400:kworker.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.881911:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787435.881969:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503772032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.882057:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503772544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787435.882084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.882103:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787435.882109:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503772416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787435.882131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.882175:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772544 00000100:00100000:1.0:1787787435.882179:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772544 00000100:00100000:1.0:1787787435.882209:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772416 00000100:00100000:1.0:1787787435.882212:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772416 00000100:00100000:1.0:1787787435.882225:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787435.882231:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503772544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787435.882254:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787435.882289:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503772544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.882296:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787435.882307:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787435.882313:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503772416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787435.882323:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787435.882347:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503772416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.882352:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787787435.882488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787435.882529:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503772288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787435.882560:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787435.882578:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787435.882584:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503772160:0@lo:400:kworker.0 00000100:00100000:2.0:1787787435.882604:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787435.882668:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503771904 00000100:00100000:2.0:1787787435.882672:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503771904 00000100:00100000:2.0:1787787435.882702:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787787435.882708:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c58fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3653:x1874630503771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787435.882743:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c58fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3653:x1874630503771904:12345-0@lo:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787435.882749:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787787435.882775:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772160 00000100:00100000:2.0:1787787435.882778:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772160 00000100:00100000:2.0:1787787435.882806:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787435.882812:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503772160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787435.882844:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503772160:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787435.882850:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787435.882883:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503772160:0@lo:400:kworker.0 00000100:00100000:2.0:1787787435.882909:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503771904:0@lo:400:kworker.0 00000100:00100000:2.0:1787787435.882926:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772288 00000100:00100000:2.0:1787787435.882929:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772288 00000100:00100000:2.0:1787787435.882962:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787435.882968:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503772288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787435.882984:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787787435.883016:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503772288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787435.883097:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787435.883119:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503772672:0@lo:400:kworker.0 00000100:00100000:2.0:1787787435.883164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787435.883279:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787435.883284:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787435.883313:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503772416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787435.883329:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503772544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787435.883452:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772672 00000100:00100000:1.0:1787787435.883457:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772672 00000100:00100000:1.0:1787787435.883495:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787435.883502:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503772672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.883536:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503772672:12345-0@lo:400:kworker.0 Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.883542:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787435.883918:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503772928:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.883961:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.883991:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503773440:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884201:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.884225:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787787435.884233:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503773056:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884256:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.884273:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503773568:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.884324:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773440 00000100:00100000:1.0:1787787435.884328:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773440 00000100:00100000:1.0:1787787435.884371:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773056 00000100:00100000:1.0:1787787435.884374:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773056 00000100:00100000:1.0:1787787435.884668:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773568 00000100:00100000:1.0:1787787435.884672:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773568 00000100:00100000:1.0:1787787435.884689:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787435.884705:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503773440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884758:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503773440:12345-0@lo:400:kworker.0 Request processed in 55us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.884765:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787435.884778:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787435.884783:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503773056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884826:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503773056:12345-0@lo:400:kworker.0 Request processed in 42us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.884832:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787435.884845:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787435.884851:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503773568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884877:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503773568:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787435.884882:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787787435.884907:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787435.884910:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787435.884959:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503772800:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.884990:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787435.885268:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772928 00000100:00100000:3.0:1787787435.885274:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772928 00000100:00100000:3.0:1787787435.885590:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787435.885602:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503772928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787435.885643:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503772928:12345-0@lo:400:kworker.0 Request processed in 46us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.885649:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787435.885814:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503773312:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.885843:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.885888:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503772288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787435.885908:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787435.885915:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503773184:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.885950:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787435.885978:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773312 00000100:00100000:1.0:1787787435.885988:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773312 00000100:00100000:3.0:1787787435.886094:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773184 00000100:00100000:3.0:1787787435.886098:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773184 00000100:00100000:0.0:1787787435.886230:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503773056:0@lo:400:kworker.0 00010000:00080000:0.0:1787787435.886244:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b21c0 x1874630503773568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787435.886254:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503773568:0@lo:400:kworker.0 00000100:00100000:0.0:1787787435.886264:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503772928:0@lo:400:kworker.0 00000100:00100000:0.0:1787787435.886274:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503773440:0@lo:400:kworker.0 00000100:00080000:0.0:1787787435.887232:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787435.887238:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787435.887242:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787435.887256:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503772800 00000100:00100000:0.0:1787787435.887263:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503772800 00000100:00100000:0.0:1787787435.887301:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787787435.887309:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503772800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787435.887384:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503772800:12345-0@lo:400:kworker.0 Request processed in 75us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787435.887391:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787435.888058:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503772672:0@lo:400:kworker.0 00000100:00100000:3.0:1787787435.891766:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787787435.891797:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503773312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787435.891916:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503773312:12345-0@lo:400:kworker.0 Request processed in 136us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.891924:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787787435.891959:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787435.891967:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503773184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787435.891999:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503773184:12345-0@lo:400:kworker.0 Request processed in 34us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787435.892014:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787787435.892267:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503773184:0@lo:400:kworker.0 00000100:00100000:1.0:1787787435.892284:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503772800:0@lo:400:kworker.0 00010000:00080000:1.0:1787787435.892298:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b0f00 x1874630503773312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787435.892309:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503773312:0@lo:400:kworker.0 10000000:01000000:1.0:1787787436.017617:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787436.017625:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff987101cdc800 from 13 10000000:01000000:1.0:1787787436.017630:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787436.017674:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.017686:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.017698:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787436.017724:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503773696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787436.017793:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787436.017899:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.021734:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773696 00000100:00100000:0.0:1787787436.021749:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773696 00000100:00100000:1.0:1787787436.022509:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787436.022521:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:17149:x1874630503773696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787436.022538:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787436.022556:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa3a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa3a0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.022584:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa3a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa3a0 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.022605:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa3a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa3a0 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.022614:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5400, rc 0) 00000100:00100000:1.0:1787787436.022692:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503773696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (4899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787436.022699:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787787436.022752:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503773696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787436.022769:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.022779:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787436.022854:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503773824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787436.022889:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787436.022921:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.023560:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773824 00000100:00100000:0.0:1787787436.023567:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773824 00000100:00100000:0.0:1787787436.023611:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787787436.023619:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503773824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.023741:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503773824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.023749:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787787436.023801:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4ed0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503773824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.023837:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503773952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.023876:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787436.023899:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1c94240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.023909:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503773952 00000100:00100000:0.0:1787787436.023912:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503773952 00000100:00100000:0.0:1787787436.023928:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787787436.023947:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503773952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.024014:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503773952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.024021:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787787436.024058:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503773952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787787436.024712:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787787436.024774:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787787436.024792:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787436.024803:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.024813:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787436.024823:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787436.024825:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc38d000 from 13 10000000:01000000:0.0:1787787436.024828:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787436.024854:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.024862:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.024879:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787436.024894:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.024944:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787436.024963:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1c94600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.024978:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774080 00000100:00100000:0.0:1787787436.024982:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774080 00000100:00100000:0.0:1787787436.025007:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787787436.025013:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:17149:x1874630503774080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787436.025023:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787436.025035:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c0031c00/0x11620bc3f30aa3b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa3ae expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.025056:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c0031c00/0x11620bc3f30aa3b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa3ae expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.025066:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c0031c00/0x11620bc3f30aa3b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa3ae expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.025074:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031c00, rc 0) 00000100:00100000:0.0:1787787436.025106:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503774080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.025112:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787787436.025166:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787436.025179:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.025193:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787436.025237:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.025260:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787436.025273:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1c94600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.025283:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774208 00000100:00100000:0.0:1787787436.025286:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774208 00000100:00100000:0.0:1787787436.025302:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787436.025308:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503774208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.025397:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503774208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.025404:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787436.025431:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.025453:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.025488:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787436.025501:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1c94600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.025511:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774336 00000100:00100000:0.0:1787787436.025514:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774336 00000100:00100000:0.0:1787787436.025531:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787787436.025535:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503774336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.025599:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503774336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.025606:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787787436.025650:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787436.034972:0:20250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787787436.036121:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787787436.036166:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787436.036179:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787436.036192:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787436.036204:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787436.036206:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff987101e33000 from 13 10000000:01000000:3.0:1787787436.036209:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787436.036266:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787436.036274:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787436.036286:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787436.036317:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787436.036395:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787436.036435:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.036534:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774464 00000100:00100000:0.0:1787787436.036542:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774464 00000100:00100000:0.0:1787787436.036587:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787787436.036596:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:17149:x1874630503774464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787436.036611:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787436.036624:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa3c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa3bc expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.036647:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa3c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa3bc expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.036657:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa3c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa3bc expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.036665:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15400, rc 0) 00000100:00100000:0.0:1787787436.036708:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503774464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.036714:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787787436.036762:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787436.036777:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.036786:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787436.036839:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.036875:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787436.036892:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1c943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.036906:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774592 00000100:00100000:0.0:1787787436.036909:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774592 00000100:00100000:0.0:1787787436.036945:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787787436.036952:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503774592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.037354:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503774592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.037362:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787436.037430:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787436.037464:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787436.037507:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787436.037535:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f110c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787436.037573:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774720 00000100:00100000:0.0:1787787436.037578:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774720 00000100:00100000:0.0:1787787436.037611:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787787436.037618:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503774720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.037698:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503774720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787436.037704:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787787436.037739:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787436.042833:0:20252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787787436.047438:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787787436.047477:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787436.047491:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.047505:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787436.047516:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787436.047520:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c5465000 from 13 10000000:01000000:0.0:1787787436.047533:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787436.047571:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.047580:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.047591:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787436.047618:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f792c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787436.047692:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787436.047744:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c4fb2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787436.047811:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774848 00000100:00100000:1.0:1787787436.047820:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774848 00000100:00100000:1.0:1787787436.047872:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787787436.047883:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:17149:x1874630503774848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787436.047895:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787436.047909:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa3d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa3ca expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.047958:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa3d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa3ca expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.047969:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa3d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa3ca expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787436.047978:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4400, rc 0) 00000100:00100000:1.0:1787787436.048045:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503774848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787436.048053:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787787436.050381:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f792c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787436.050418:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787436.050432:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787436.050525:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787436.050593:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787436.050626:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2be4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787436.050650:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503774976 00000100:00100000:2.0:1787787436.050655:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503774976 00000100:00100000:2.0:1787787436.050708:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787787436.050717:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503774976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787436.050846:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503774976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787436.050854:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787787436.050894:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503774976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787436.050922:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503775104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787436.050976:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787436.051009:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2be4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787436.051020:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503775104 00000100:00100000:2.0:1787787436.051024:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503775104 00000100:00100000:2.0:1787787436.051300:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787787436.051308:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503775104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787436.051389:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:17149:x1874630503775104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787436.051396:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787787436.051434:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:655a2ac3-6e05-4716-af47-ef6019dc5f23:17149:1874630503775104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787436.053382:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787787436.053580:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787787436.053604:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787436.053615:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.053626:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787436.779174:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787437.232440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787437.232527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787437.232565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787437.232600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787437.232612:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815360 00000100:00100000:3.0:1787787437.232620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787437.232623:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815360 00000100:00100000:3.0:1787787437.232648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787437.232672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787437.232696:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:2.0:1787787437.232707:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2394:x1874630484815360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787437.232715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787437.232746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787437.232773:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815872 00000100:00100000:3.0:1787787437.232778:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815872 00000100:00100000:2.0:1787787437.232793:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2394:x1874630484815360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787437.232803:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:3.0:1787787437.232816:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816384 00000100:00100000:3.0:1787787437.232854:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816384 00000100:00100000:2.0:1787787437.232854:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815744 00000100:00100000:2.0:1787787437.232860:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815744 00000100:00100000:3.0:1787787437.232879:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816256 00000100:00100000:3.0:1787787437.232883:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816256 00000100:00100000:2.0:1787787437.232897:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:2.0:1787787437.232976:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484815872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787437.233007:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484815872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787437.233021:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815616 00000100:00100000:1.0:1787787437.233027:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815616 00000100:00100000:1.0:1787787437.233054:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816128 00000100:00100000:1.0:1787787437.233058:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816128 00000100:00100000:1.0:1787787437.233069:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484815488 00000100:00100000:1.0:1787787437.233071:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484815488 00000100:00100000:1.0:1787787437.233082:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816000 00000100:00100000:1.0:1787787437.233085:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816000 00000100:00100000:1.0:1787787437.233100:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1787787437.233107:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484815616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787437.233170:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484815616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787437.233177:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1787787437.233190:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:1.0:1787787437.233197:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484816128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787437.233222:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484816128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787437.233236:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:1.0:1787787437.233249:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:1.0:1787787437.233256:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2394:x1874630484815488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787437.233284:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2394:x1874630484815488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787437.233290:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:1.0:1787787437.233300:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:1.0:1787787437.233305:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2394:x1874630484816000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787437.233327:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2394:x1874630484816000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787437.233333:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:3.0:1787787437.233612:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:3.0:1787787437.233622:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484816384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787437.233659:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484816384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 39us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787437.233667:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:3.0:1787787437.233681:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1787787437.233687:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484815744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787437.233711:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484815744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787437.233716:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1787787437.233727:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:3.0:1787787437.233734:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484816256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787437.233756:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484816256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787437.233762:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00080000:3.0:1787787437.233845:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787437.233850:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787437.233853:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787437.233855:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787437.238281:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00010000:00010000:2.0:1787787437.801756:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787437.929751:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787437.929776:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503775232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787437.929845:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787437.929956:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503775232 00000100:00100000:3.0:1787787437.929964:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503775232 00000100:00100000:3.0:1787787437.930041:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787437.930050:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503775232:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787787437.930224:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787787437.930473:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787437.930534:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503775232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 485us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787437.930542:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787437.930636:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503775232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787438.007218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.019317:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816512 00000100:00100000:1.0:1787787438.019334:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816512 00000100:00100000:1.0:1787787438.019423:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:1.0:1787787438.019435:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:15560:x1874630484816512:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787438.019456:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787438.019534:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa3d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85c5 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019608:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019638:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019654:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019672:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019678:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019684:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019771:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30aa3ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019779:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30aa3ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019785:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30aa3ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787438.019815:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787787438.019819:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787438.019857:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30aa3ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019868:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019884:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019901:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019907:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787438.019911:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019918:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019930:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:1.0:1787787438.019933:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787438.019937:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019943:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019956:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019961:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019966:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019970:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787438.019979:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019985:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.019992:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9870d8b94300) 00010000:00010000:1.0:1787787438.019995:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787438.019998:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.020003:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa3e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.020034:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa3d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85c5 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.020046:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30aa3ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85c5 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.020053:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9870d8b94800) 00010000:00010000:1.0:1787787438.020055:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787438.020058:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4800, rc 0) 00000100:00100000:1.0:1787787438.020225:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:15560:x1874630484816512:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 792us (13019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787438.020233:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1787787438.032086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.032634:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816640 00000100:00100000:2.0:1787787438.032643:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816640 00000100:00100000:2.0:1787787438.032757:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:2.0:1787787438.032768:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:15560:x1874630484816640:12345-192.168.204.31@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787787438.032853:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:15560:x1874630484816640:12345-192.168.204.31@tcp:900:lhsmtool_posix.0 Request processed in 87us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787438.032861:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:2.0:1787787438.048384:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.048476:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484816896 00000100:00100000:3.0:1787787438.048487:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484816896 00000100:00100000:3.0:1787787438.048541:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1787787438.048550:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:15560:x1874630484816896:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787438.048569:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787438.048601:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa3f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85cc expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.048675:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.048690:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.048703:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.048764:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.048773:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.048779:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049047:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aa409 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049057:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aa409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049064:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aa409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787438.049074:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787787438.049315:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049324:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049331:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049336:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787438.049341:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049351:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049363:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9870d8b94800) 00010000:00010000:3.0:1787787438.049366:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787438.049370:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049398:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa3fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049413:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049419:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049424:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049429:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787438.049432:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049438:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049447:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff986fc2a1c800) 00010000:00010000:3.0:1787787438.049450:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787438.049452:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.049458:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa402 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.050515:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa3f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85cc expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.050548:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aa409 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85cc expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.050557:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a1c700) 00010000:00010000:3.0:1787787438.050560:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787438.050562:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7800, rc 0) 00000100:00100000:3.0:1787787438.050632:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15560:x1874630484816896:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 2083us (2257us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787787438.050641:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:0.0:1787787438.063672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.065067:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817024 00000100:00100000:1.0:1787787438.065081:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817024 00000100:00100000:1.0:1787787438.065203:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787438.065215:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15560:x1874630484817024:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787787438.065357:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15560:x1874630484817024:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 144us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787438.065365:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:0.0:1787787438.067999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.068073:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817152 00000100:00100000:3.0:1787787438.068083:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817152 00000100:00100000:3.0:1787787438.068173:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:3.0:1787787438.068194:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:15560:x1874630484817152:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787787438.069556:0:17152:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1319us 00000100:00100000:3.0:1787787438.087031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.087110:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817280 00000100:00100000:2.0:1787787438.087130:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817280 00000100:00100000:2.0:1787787438.087212:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:2.0:1787787438.087223:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15566:x1874630484817280:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787438.087243:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787438.087266:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85d3 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087332:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087345:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087357:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087372:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087379:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087386:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087442:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087450:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087457:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087462:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787438.087467:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087474:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087488:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:2.0:1787787438.087491:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787438.087496:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087502:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa41e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087515:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087520:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087525:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087537:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787438.087540:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087547:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087555:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff986fc39d3e00) 00010000:00010000:2.0:1787787438.087557:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787438.087571:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087578:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087609:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa417 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85d3 expref: 10 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087618:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:2.0:1787787438.087621:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787438.087625:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85d3 expref: 10 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.087634:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2400, rc 0) 00000100:00100000:2.0:1787787438.087695:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15566:x1874630484817280:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 473us (674us total) trans 0 rc 301/301 00000100:00100000:2.0:1787787438.087702:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787438.097133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.098269:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:15560:x1874630484817152:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 30081us (30273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787438.098284:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:1.0:1787787438.099739:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817408 00000100:00100000:1.0:1787787438.099753:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817408 00000100:00100000:1.0:1787787438.100495:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:1.0:1787787438.100511:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15566:x1874630484817408:12345-192.168.204.31@tcp:700:lfs.0 00000100:00100000:1.0:1787787438.100835:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15566:x1874630484817408:12345-192.168.204.31@tcp:700:lfs.0 Request processed in 328us (3711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787438.100843:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:2.0:1787787438.111644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.111828:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817664 00000100:00100000:3.0:1787787438.111842:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817664 00000100:00100000:3.0:1787787438.111933:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:3.0:1787787438.111956:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15566:x1874630484817664:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1787787438.112194:0:17154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787438.112236:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aa345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8540 expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.112282:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:3.0:1787787438.112290:0:17154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787438.112475:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.112504:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 5 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.112533:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.112576:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 5 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.112594:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 5 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787438.112629:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1874630503775360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787438.112738:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787438.118479:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1874630503775360:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787438.118514:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787438.119613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.119692:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817792 00000100:00100000:3.0:1787787438.119704:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817792 00010000:00010000:3.0:1787787438.119764:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 6 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787438.119813:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787438.119825:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2392:x1874630484817792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787438.119844:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787438.119852:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 6 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.119869:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 6 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.119910:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aa384 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b0 expref: 6 pid: 17153 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.119931:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:3.0:1787787438.119938:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.119953:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.119964:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.120019:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787438.120095:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2392:x1874630484817792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 271us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787438.120109:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00010000:00010000:0.0:1787787438.120120:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.120168:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.120229:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.120246:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.120260:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127537:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127562:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127575:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787438.127592:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4c9917e reply state 00000000acebc7c9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127624:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127632:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787438.127635:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787438.127640:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787787438.127646:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787787438.127655:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127662:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127668:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127674:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787438.127678:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127696:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127709:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9870d0b9e400) 00010000:00010000:0.0:1787787438.127712:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787438.127716:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127724:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aa42c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787438.127751:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4c9917e reply state 00000000acebc7c9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127760:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.127767:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9870d0b9ed00) 00010000:00010000:0.0:1787787438.127769:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787438.127771:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787787438.128703:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+10:15566:x1874630484817664:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 16750us (17065us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787787438.128716:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:2.0:1787787438.264072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.264173:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484817920 00000100:00100000:3.0:1787787438.264182:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484817920 00000100:00100000:3.0:1787787438.264245:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:3.0:1787787438.264256:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+10:15574:x1874630484817920:12345-192.168.204.31@tcp:101:lctl.0 00010000:00010000:3.0:1787787438.264278:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787438.264301:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85da expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.264367:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa448 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.264381:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.264392:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787438.264435:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787438.264439:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787438.264476:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.264503:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85da expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.264542:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85da expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.264552:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:3.0:1787787438.264555:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787438.264558:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6000, rc 0) 00000100:00100000:3.0:1787787438.264622:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+11:15574:x1874630484817920:12345-192.168.204.31@tcp:101:lctl.0 Request processed in 367us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787438.264630:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:3.0:1787787438.302337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.302449:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484818048 00000100:00100000:2.0:1787787438.302460:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484818048 00000100:00100000:2.0:1787787438.302525:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787438.302536:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:15575:x1874630484818048:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787438.302557:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787438.302579:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85e1 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.302645:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.302658:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.302669:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787438.302719:0:18576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787438.302723:0:18576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787438.302743:0:18576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.302766:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85e1 expref: 7 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.302783:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85e1 expref: 6 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.302808:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:2.0:1787787438.302811:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787438.302815:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3400, rc 0) 00000100:00100000:2.0:1787787438.302876:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15575:x1874630484818048:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 343us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787438.302883:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787438.309210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.309757:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484818176 00000100:00100000:3.0:1787787438.309768:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484818176 00000100:00100000:3.0:1787787438.309829:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:3.0:1787787438.309840:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:15575:x1874630484818176:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787438.309861:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787438.309881:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85e8 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.309955:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.309968:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.309978:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310008:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310016:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310022:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310099:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa472 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310108:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310116:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787438.310445:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787438.310450:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787438.310470:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310541:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310548:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310554:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310572:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787438.310576:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310585:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310598:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:3.0:1787787438.310601:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787438.310606:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310613:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310627:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310634:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310639:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310644:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787438.310647:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310652:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310672:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9870d0b9ed00) 00010000:00010000:3.0:1787787438.310674:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787438.310677:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310684:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa46b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310713:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85e8 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310726:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa472 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85e8 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.310732:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:3.0:1787787438.310734:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787438.310737:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7a00, rc 0) 00000100:00100000:3.0:1787787438.310858:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+7:15575:x1874630484818176:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1019us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787438.310867:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:2.0:1787787438.315411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.315498:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484818304 00000100:00100000:3.0:1787787438.315509:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484818304 00000100:00100000:3.0:1787787438.315597:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:3.0:1787787438.315607:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:15575:x1874630484818304:12345-192.168.204.31@tcp:900:lfs.0 00000100:00100000:3.0:1787787438.315731:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:15575:x1874630484818304:12345-192.168.204.31@tcp:900:lfs.0 Request processed in 125us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787438.315740:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:0.0:1787787438.319819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.320055:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484818560 00000100:00100000:2.0:1787787438.320065:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484818560 00000100:00100000:2.0:1787787438.320245:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:2.0:1787787438.320256:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+7:15575:x1874630484818560:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787438.320275:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787438.320297:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85ef expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787438.320402:0:18576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787787438.320499:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa479 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85ef expref: 9 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.320514:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:2.0:1787787438.320517:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787438.320522:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85ef expref: 9 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.320536:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787438.320658:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+8:15575:x1874630484818560:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 403us (847us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787787438.320666:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:1.0:1787787438.324467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.324565:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484818816 00000100:00100000:0.0:1787787438.324576:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484818816 00000100:00100000:0.0:1787787438.324636:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:0.0:1787787438.324646:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+8:15575:x1874630484818816:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1787787438.324703:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787438.324743:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa472 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85e8 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.324764:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787438.324769:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787438.324791:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.324804:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.324815:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787438.325053:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d549884 reply state 000000007d32cc67 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.325066:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.325073:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787438.325075:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787787438.325078:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787787438.325085:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787787438.325202:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+9:15575:x1874630484818816:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 557us (743us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787787438.325210:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:3.0:1787787438.327744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.327823:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484819072 00000100:00100000:1.0:1787787438.327833:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484819072 00000100:00100000:1.0:1787787438.327896:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:1.0:1787787438.327907:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+9:15575:x1874630484819072:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1787787438.328124:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+10:15575:x1874630484819072:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 218us (398us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787787438.328172:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:1.0:1787787438.335912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.336189:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484819328 00000100:00100000:0.0:1787787438.336199:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484819328 00000100:00100000:0.0:1787787438.336253:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:0.0:1787787438.336262:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+10:15575:x1874630484819328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787438.336301:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787438.336322:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa48e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85f6 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336397:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336411:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336423:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336433:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336440:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336447:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787438.336550:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787787438.336620:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336627:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336633:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336647:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787438.336651:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336658:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336670:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:0.0:1787787438.336672:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787438.336677:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336683:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336698:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336704:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336709:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336713:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787438.336716:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336721:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336739:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9870d0b9ed00) 00010000:00010000:0.0:1787787438.336742:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787438.336745:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336751:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa49c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336783:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa48e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85f6 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336794:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:0.0:1787787438.336796:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787438.336800:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa48e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85f6 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.336822:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659800, rc 0) 00000100:00100000:0.0:1787787438.336894:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+11:15575:x1874630484819328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 623us (982us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787787438.336903:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:2.0:1787787438.340530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.342718:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484819456 00000100:00100000:0.0:1787787438.342734:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484819456 00000100:00100000:0.0:1787787438.342807:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:0.0:1787787438.342818:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+11:15575:x1874630484819456:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787438.342841:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787438.342863:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa4aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c85fd expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.342986:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.343012:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.343024:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787438.343050:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787438.343055:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787438.343073:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.343100:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa4aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 13 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.343121:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.343348:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787438.343351:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787438.343355:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659400, rc 0) 00000100:00100000:0.0:1787787438.343415:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+12:15575:x1874630484819456:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 598us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787438.343422:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:3.0:1787787438.355562:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.355655:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484819584 00000100:00100000:1.0:1787787438.355666:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484819584 00000100:00100000:1.0:1787787438.355737:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:1.0:1787787438.355760:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+12:15575:x1874630484819584:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:3.0:1787787438.372235:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+12:15575:x1874630484819584:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 16461us (16683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787438.372250:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1787787438.376760:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.376844:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484819840 00000100:00100000:3.0:1787787438.376854:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484819840 00000100:00100000:3.0:1787787438.377059:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:3.0:1787787438.377070:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+12:15575:x1874630484819840:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787438.377674:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+13:15575:x1874630484819840:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 604us (924us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787787438.377682:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:3.0:1787787438.443080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.443265:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484819968 00000100:00100000:0.0:1787787438.443275:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484819968 00000100:00100000:0.0:1787787438.443352:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:0.0:1787787438.443362:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+11:15581:x1874630484819968:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787438.443383:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787438.443403:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa4b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8604 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443468:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443483:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443495:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443506:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443513:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443520:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443595:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa4cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443604:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa4cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443611:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa4cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787438.443655:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787438.443659:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787438.443700:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa4cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443712:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443718:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443725:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443730:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787438.443734:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443741:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443753:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:0.0:1787787438.443756:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787438.443761:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443767:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443780:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443795:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443801:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443806:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787438.443809:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443814:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443822:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9870d0b9ed00) 00010000:00010000:0.0:1787787438.443825:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787438.443828:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443834:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443860:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa4b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8604 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443874:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa4cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8604 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.443881:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787438.443893:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787787438.443903:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659600, rc 0) 00000100:00100000:0.0:1787787438.443969:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:15581:x1874630484819968:12345-192.168.204.31@tcp:101:bash.0 Request processed in 609us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787438.443977:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:1.0:1787787438.447704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.447796:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484820096 00000100:00100000:2.0:1787787438.447805:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484820096 00000100:00100000:2.0:1787787438.447861:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787438.447869:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:15581:x1874630484820096:12345-192.168.204.31@tcp:900:bash.0 00000100:00100000:2.0:1787787438.447973:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:15581:x1874630484820096:12345-192.168.204.31@tcp:900:bash.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787438.447980:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:1.0:1787787438.450679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.450914:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484820352 00000100:00100000:0.0:1787787438.450925:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484820352 00000100:00100000:0.0:1787787438.451001:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:0.0:1787787438.451010:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:15581:x1874630484820352:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787438.451029:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787438.451048:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa4d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c860b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.451173:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.451188:0:17152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.451197:0:17152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.451230:0:17152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.451244:0:17152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 12 pid: 17152 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787438.451257:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17152:1874630503775488:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787438.451349:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fb840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787438.455061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.455233:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484820480 00000100:00100000:2.0:1787787438.455242:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484820480 00010000:00010000:2.0:1787787438.455279:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 13 pid: 17152 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787438.455314:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1787787438.455323:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+13:2391:x1874630484820480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787438.455337:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787438.455344:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 13 pid: 17152 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.455358:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 13 pid: 17152 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.455381:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:2.0:1787787438.455400:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.455410:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.455418:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.455440:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787438.455503:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+13:2391:x1874630484820480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 181us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787438.455512:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00010000:00010000:1.0:1787787438.455608:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa4b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85fd expref: 12 pid: 17152 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787438.455626:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17152:1874630503775488:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787438.455648:0:17152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.455657:0:17152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.455663:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.455685:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.455693:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.455701:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456273:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456285:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456305:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787438.456316:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787787438.456344:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456352:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456359:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456364:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787438.456368:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456374:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456383:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:1.0:1787787438.456386:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787438.456389:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456395:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa4db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787438.456405:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000249f16fa reply state 000000005a30724a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456424:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456430:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9870d8b94300) 00010000:00010000:1.0:1787787438.456432:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787787438.456434:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787787438.456467:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa4d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 15 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456481:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 14 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787438.456488:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787438.456490:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787787438.456493:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4000, rc 0) 00000100:00100000:1.0:1787787438.456529:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+15:15581:x1874630484820352:12345-192.168.204.31@tcp:101:bash.0 Request processed in 5520us (5862us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787787438.456537:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:1.0:1787787438.473480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.473583:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484820608 00000100:00100000:0.0:1787787438.473594:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484820608 00000100:00100000:0.0:1787787438.473698:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:0.0:1787787438.473709:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+15:15581:x1874630484820608:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787438.473734:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787438.473754:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa4f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8612 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.473822:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.473837:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.473848:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787438.473911:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787438.473916:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787438.474050:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.474062:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.474088:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa4f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8612 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.474105:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8612 expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.474248:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787438.474252:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787438.474256:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658000, rc 0) 00000100:00100000:0.0:1787787438.474405:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+16:15581:x1874630484820608:12345-192.168.204.31@tcp:101:bash.0 Request processed in 697us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787438.474412:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:1.0:1787787438.477246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.477336:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484820864 00000100:00100000:3.0:1787787438.477346:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484820864 00000100:00100000:3.0:1787787438.477403:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:3.0:1787787438.477414:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+16:15581:x1874630484820864:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1787787438.477803:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+17:15581:x1874630484820864:12345-192.168.204.31@tcp:35:bash.0 Request processed in 389us (567us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787787438.477811:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:1.0:1787787438.572077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.572166:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484821120 00000100:00100000:3.0:1787787438.572176:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484821120 00000100:00100000:3.0:1787787438.572236:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:3.0:1787787438.572246:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+17:15591:x1874630484821120:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787438.572270:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787438.572289:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8619 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787438.572400:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787787438.572497:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa505 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8619 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.572511:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:3.0:1787787438.572514:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787438.572519:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8619 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.572534:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6600, rc 0) 00000100:00100000:3.0:1787787438.572891:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+18:15591:x1874630484821120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 634us (811us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787787438.572900:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:2.0:1787787438.578249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.578606:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484821376 00000100:00100000:1.0:1787787438.578617:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484821376 00000100:00100000:0.0:1787787438.578791:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:0.0:1787787438.578808:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+18:15591:x1874630484821376:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787438.579046:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+19:15591:x1874630484821376:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 238us (1923us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787787438.579053:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:1.0:1787787438.637241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787438.637505:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484821632 00000100:00100000:2.0:1787787438.637518:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484821632 00000100:00100000:2.0:1787787438.637679:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:2.0:1787787438.637689:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+19:15594:x1874630484821632:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787438.637711:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787438.637732:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa513 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8620 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.638121:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa51a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.638373:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa51a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.638386:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa51a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787438.638417:0:18576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787787438.638528:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa513 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8620 expref: 22 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.638545:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa51a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8620 expref: 21 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787438.638554:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:2.0:1787787438.638557:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787438.638635:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787438.638761:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15594:x1874630484821632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1073us (1530us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787787438.638770:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:1.0:1787787438.645710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787438.645819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787438.646076:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484821888 00000100:00100000:0.0:1787787438.646086:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484821888 00000100:00100000:0.0:1787787438.646179:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:0.0:1787787438.646189:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15594:x1874630484821888:12345-192.168.204.31@tcp:54:lfs.0 00010000:00010000:0.0:1787787438.646256:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646273:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646285:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646319:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646342:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646349:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646355:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787438.646359:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646367:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646379:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787438.646382:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787438.646387:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787438.646393:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa528 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787438.646466:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15594:x1874630484821888:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 278us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787438.646474:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:3.0:1787787438.649784:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484821760 00000100:00100000:3.0:1787787438.649809:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484821760 00000100:00100000:3.0:1787787438.649893:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:3.0:1787787438.649903:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:2393:x1874630484821760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787438.649920:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787438.649954:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa51a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8620 expref: 21 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787438.649972:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787438.649977:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787438.650690:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+20:2393:x1874630484821760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 784us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787438.650717:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:1.0:1787787438.651075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787438.652919:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484822144 00000100:00100000:3.0:1787787438.653037:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484822144 00000100:00100000:3.0:1787787438.653151:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:3.0:1787787438.653162:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+20:15594:x1874630484822144:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787438.653443:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15594:x1874630484822144:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 282us (2367us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787787438.653451:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00010000:00010000:0.0:1787787438.826733:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787438.953382:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503775616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787438.953482:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787438.953592:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503775616 00000100:00100000:0.0:1787787438.953599:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503775616 00000100:00100000:0.0:1787787438.953653:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787438.953663:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503775616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787438.953714:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787438.953836:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503775744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787438.953867:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787438.953914:0:17158:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787787438.953923:0:17158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787787438.954053:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503775744 00000100:00100000:2.0:1787787438.954057:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503775744 00000100:00100000:2.0:1787787438.954181:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787438.954189:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503775744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787438.954207:0:20292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787438.954240:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503775744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787438.954247:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787438.954287:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503775744:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787787438.954518:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787438.955652:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503775616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1984us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787438.955665:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787787438.955746:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503775616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787439.057567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787439.057644:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484822400 00000100:00100000:2.0:1787787439.057654:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484822400 00000100:00100000:2.0:1787787439.057742:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787439.057754:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15625:x1874630484822400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1787787439.057780:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787439.057804:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa52f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8627 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787787439.058413:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787787439.060711:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa536 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.060737:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa536 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.060751:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa536 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787439.060769:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787787439.060936:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa52f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8627 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.060955:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa536 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8627 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.060964:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:2.0:1787787439.060967:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787439.060970:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787439.061118:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+23:15625:x1874630484822400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3367us (3561us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787787439.061267:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787439.076784:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787439.077257:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484822528 00000100:00100000:1.0:1787787439.077268:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484822528 00000100:00100000:1.0:1787787439.077337:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1787787439.077349:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+23:2391:x1874630484822528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787439.077364:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787439.077400:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa536 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8627 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.077422:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787439.077426:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787439.077505:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+22:2391:x1874630484822528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 158us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787439.077513:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1787787439.080329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787439.080625:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484822784 00000100:00100000:0.0:1787787439.080636:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484822784 00000100:00100000:0.0:1787787439.080696:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1787787439.080708:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+22:15625:x1874630484822784:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1787787439.081010:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+23:15625:x1874630484822784:12345-192.168.204.31@tcp:35:cat.0 Request processed in 304us (692us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787787439.081017:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000040:00080000:3.0:1787787439.086942:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787439.185507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787439.187179:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484823040 00000100:00100000:1.0:1787787439.187193:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484823040 00000100:00100000:1.0:1787787439.187281:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:1.0:1787787439.187293:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+23:15631:x1874630484823040:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1787787439.187318:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787439.187340:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa544 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c862e expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.187464:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa54b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.187480:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.187510:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787439.187521:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787787439.187648:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa544 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c862e expref: 26 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.187667:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa54b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c862e expref: 25 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.187676:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787439.187678:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787439.187681:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5800, rc 0) 00000100:00100000:1.0:1787787439.187743:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15631:x1874630484823040:12345-192.168.204.31@tcp:101:dd.0 Request processed in 453us (2246us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787787439.187751:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1787787439.200717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787439.200965:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484823168 00000100:00100000:1.0:1787787439.200977:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484823168 00000100:00100000:1.0:1787787439.201044:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:1.0:1787787439.201054:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15631:x1874630484823168:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:1.0:1787787439.201076:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787439.201096:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa559 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8635 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.201128:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.201181:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.201192:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787439.202629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787439.202839:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484823296 00000100:00100000:3.0:1787787439.202847:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484823296 00000100:00100000:3.0:1787787439.202923:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:3.0:1787787439.202944:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+27:2394:x1874630484823296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787439.202971:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa559 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 28 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.202995:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 27 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787439.203004:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787439.203007:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787439.203010:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5000, rc 0) 00010000:00010000:3.0:1787787439.203095:0:18684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787787439.203132:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+27:15631:x1874630484823168:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2078us (2424us total) trans 0 rc 0/0 00010000:00010000:3.0:1787787439.203135:0:18684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa54b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c862e expref: 27 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787439.203181:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00010000:00010000:3.0:1787787439.203186:0:18684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787439.203193:0:18684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787439.206028:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:2394:x1874630484823296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3074us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787439.206525:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:1.0:1787787439.223634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787439.223715:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484823552 00000100:00100000:0.0:1787787439.223727:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484823552 00000100:00100000:0.0:1787787439.223830:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:0.0:1787787439.223841:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15631:x1874630484823552:12345-192.168.204.31@tcp:36:dd.0 00010000:00010000:0.0:1787787439.223911:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787439.223951:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa4fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8612 expref: 25 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.224909:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787439.224920:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787439.225107:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.225123:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.225178:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787439.225225:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787787439.225260:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a04bc24a reply state 00000000b369efbc transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.225272:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.225280:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787439.225283:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787439.225286:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787439.225404:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+27:15631:x1874630484823552:12345-192.168.204.31@tcp:36:dd.0 Request processed in 1561us (1778us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787787439.225412:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000020:00080000:0.0:1787787439.225417:0:17152:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787787439.328998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787439.329084:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484823808 00000100:00100000:0.0:1787787439.329095:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484823808 00000100:00100000:0.0:1787787439.329204:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:0.0:1787787439.329215:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+27:15631:x1874630484823808:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:0.0:1787787439.329437:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+28:15631:x1874630484823808:12345-192.168.204.31@tcp:35:dd.0 Request processed in 223us (448us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1787787439.329445:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:2.0:1787787439.624320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787439.624424:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484823936 00000100:00100000:0.0:1787787439.624434:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484823936 00000100:00100000:0.0:1787787439.624509:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:0.0:1787787439.624520:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+28:15645:x1874630484823936:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:0.0:1787787439.624557:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787439.624578:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa56e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c863c expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624660:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624675:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624686:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624698:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624705:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624711:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624784:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624794:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.624801:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787439.624850:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787439.624870:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787439.625059:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625074:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625083:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625089:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625096:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625101:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787439.625105:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625113:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625124:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787439.625127:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787439.625131:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625188:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa575 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625203:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625218:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625223:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625228:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787439.625231:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625238:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625246:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9870d8b94300) 00010000:00010000:0.0:1787787439.625249:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787439.625252:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625258:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa57c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625284:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa56e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c863c expref: 30 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625298:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c863c expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787439.625304:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787439.625307:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787439.625315:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659e00, rc 0) 00000100:00100000:0.0:1787787439.625558:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+29:15645:x1874630484823936:12345-192.168.204.31@tcp:101:stat.0 Request processed in 1039us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787439.625567:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:1.0:1787787439.716347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787439.716447:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484824192 00000100:00100000:3.0:1787787439.716457:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484824192 00000100:00100000:3.0:1787787439.716522:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:3.0:1787787439.716533:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+29:15651:x1874630484824192:12345-192.168.204.31@tcp:36:truncate.0 00010000:00010000:3.0:1787787439.716590:0:17153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787439.716771:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659e00/0x11620bc3f30aa583 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c863c expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787439.716794:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787439.716799:0:17153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787439.717110:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787439.717125:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787439.717134:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787439.717277:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787787439.717301:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ad12416 reply state 000000007afe6080 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787439.717313:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787439.717319:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787439.717322:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787439.717336:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787439.717461:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+31:15651:x1874630484824192:12345-192.168.204.31@tcp:36:truncate.0 Request processed in 929us (1125us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787787439.717469:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00000020:00080000:3.0:1787787439.717474:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787787439.849350:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787439.901818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787439.901937:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484824320 00000100:00100000:2.0:1787787439.901948:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484824320 00000100:00100000:2.0:1787787439.902013:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:2.0:1787787439.902024:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+31:15665:x1874630484824320:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:2.0:1787787439.902048:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787439.902070:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30aa591 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8643 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902167:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902182:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902194:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902206:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902213:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902238:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902319:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902329:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902337:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787439.902381:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787787439.902386:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787439.902408:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902421:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902430:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902437:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902444:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902450:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787439.902454:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902468:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902492:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:2.0:1787787439.902496:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787439.902501:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902508:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3e00/0x11620bc3f30aa598 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902523:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902529:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902535:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902540:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787439.902542:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902548:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902556:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9870d8b94300) 00010000:00010000:2.0:1787787439.902558:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787439.902561:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902577:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa59f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902610:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30aa591 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 33 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902623:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 32 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787439.902630:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:2.0:1787787439.902631:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787439.902634:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3200, rc 0) 00000100:00100000:2.0:1787787439.902704:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+32:15665:x1874630484824320:12345-192.168.204.31@tcp:101:stat.0 Request processed in 682us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787439.902712:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:2.0:1787787440.032624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787440.032746:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484824576 00000100:00100000:0.0:1787787440.032756:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484824576 00000100:00100000:0.0:1787787440.032882:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:0.0:1787787440.032893:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+32:15675:x1874630484824576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787440.032914:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787440.032946:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa5ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c864a expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787440.033044:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787787440.033168:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa5ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c864a expref: 34 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.033183:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:0.0:1787787440.033186:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787440.033191:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa5ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c864a expref: 34 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.033207:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658000, rc 0) 00000100:00100000:0.0:1787787440.033270:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+33:15675:x1874630484824576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 379us (657us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1787787440.033277:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:3.0:1787787440.036733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787440.036839:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484824832 00000100:00100000:0.0:1787787440.036862:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484824832 00000100:00100000:0.0:1787787440.037087:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787440.037098:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+33:15675:x1874630484824832:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787440.037367:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+34:15675:x1874630484824832:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 271us (642us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787787440.037375:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:2.0:1787787440.124122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787440.124298:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825088 00000100:00100000:0.0:1787787440.124310:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825088 00000100:00100000:0.0:1787787440.124377:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:0.0:1787787440.124387:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+34:15681:x1874630484825088:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787440.124410:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787440.124431:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa5bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8651 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124560:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124575:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124584:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 35 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124594:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124626:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 35 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124651:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 35 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.124665:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1874630503775872:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787440.124756:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.124766:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.124774:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1874630503776000:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787440.124797:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.127799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787440.127885:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825216 00000100:00100000:3.0:1787787440.128294:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825216 00010000:00010000:3.0:1787787440.128336:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 36 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787440.128462:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:3.0:1787787440.128473:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5bac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+36:2393:x1874630484825216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787440.128487:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787440.128495:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 36 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.128509:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 36 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.128534:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787440.128540:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.128549:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.128556:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787440.128608:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5bac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+36:2393:x1874630484825216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 137us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.128630:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00010000:00010000:0.0:1787787440.128744:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3200/0x11620bc3f30aa5a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8643 expref: 35 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.128762:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1874630503775872:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787440.128773:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1874630503776000:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787440.128796:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787440.128953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787440.129511:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825344 00000100:00100000:1.0:1787787440.129517:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825344 00010000:00010000:1.0:1787787440.129541:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.129564:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:1.0:1787787440.129572:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+35:2391:x1874630484825344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787440.129593:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787440.129598:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129609:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129624:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa4e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c860b expref: 35 pid: 17152 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129636:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787440.129641:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129649:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129657:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129678:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787440.129712:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+34:2391:x1874630484825344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 142us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.129719:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00010000:00010000:1.0:1787787440.129767:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129774:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787440.129801:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787787440.129939:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658000/0x11620bc3f30aa5bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 35 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129954:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.129961:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787440.129964:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787440.129966:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658e00, rc 0) 00000100:00100000:1.0:1787787440.129993:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+34:15681:x1874630484825088:12345-192.168.204.31@tcp:101:bash.0 Request processed in 5609us (5887us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1787787440.130000:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:2.0:1787787440.133374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787440.133422:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825600 00000100:00100000:3.0:1787787440.133433:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825600 00000100:00100000:3.0:1787787440.133485:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:3.0:1787787440.133494:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+34:15681:x1874630484825600:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:3.0:1787787440.133788:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.133805:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.133817:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787440.133872:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1787787440.133895:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c96ef86f reply state 00000000e6dc855e transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.133918:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.134043:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787440.134046:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787440.134051:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787440.134431:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15681:x1874630484825600:12345-192.168.204.31@tcp:36:bash.0 Request processed in 935us (1065us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1787787440.134440:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000020:00080000:3.0:1787787440.134445:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787787440.143199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787440.143357:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825728 00000100:00100000:1.0:1787787440.143367:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825728 00000100:00100000:1.0:1787787440.143430:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1787787440.143440:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15681:x1874630484825728:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1787787440.143464:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787440.143485:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa5d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8658 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.143541:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8658 expref: 38 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.143557:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8658 expref: 38 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.143598:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787440.143601:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787440.143605:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5800, rc 0) 00000100:00100000:1.0:1787787440.143666:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15681:x1874630484825728:12345-192.168.204.31@tcp:101:bash.0 Request processed in 227us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.143673:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:2.0:1787787440.154372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787440.154529:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825856 00000100:00100000:0.0:1787787440.154539:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825856 00000100:00100000:0.0:1787787440.154596:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:0.0:1787787440.154605:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15681:x1874630484825856:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787440.154640:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787440.154660:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c865f expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.154762:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.154778:0:17152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 39 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.154787:0:17152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.154821:0:17152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 39 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.154836:0:17152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 39 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.154861:0:17152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17152:1874630503776128:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787440.155113:0:17152:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c33fb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.159008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787440.159184:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484825984 00000100:00100000:1.0:1787787440.159193:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484825984 00000100:00100000:0.0:1787787440.159231:0:17152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17152:1874630503776128:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787440.159234:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 40 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.159256:0:17152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.159273:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787440.159292:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+40:2392:x1874630484825984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787440.159308:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787440.159314:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 40 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.159328:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 40 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.159350:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa5c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8651 expref: 40 pid: 17154 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.159365:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787440.159370:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.159392:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.159399:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.159426:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787440.159445:0:17152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.159452:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.159477:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+39:2392:x1874630484825984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 196us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.159485:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000004:00200000:0.0:1787787440.159509:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787440.159514:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787440.159533:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.159561:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c865f expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.159575:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c865f expref: 38 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.159582:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787440.159586:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787440.159588:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659800, rc 0) 00000100:00100000:0.0:1787787440.159615:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15681:x1874630484825856:12345-192.168.204.31@tcp:101:bash.0 Request processed in 5011us (5252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787440.159622:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:2.0:1787787440.163532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787440.163649:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484826240 00000100:00100000:3.0:1787787440.163669:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484826240 00000100:00100000:3.0:1787787440.163734:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1787787440.163744:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15681:x1874630484826240:12345-192.168.204.31@tcp:103:bash.0 00010000:00010000:3.0:1787787440.163758:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787787440.163781:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa5d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8658 expref: 38 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.163802:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659800/0x11620bc3f30aa5e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c865f expref: 37 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.163812:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787440.163817:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787440.163876:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+36:15681:x1874630484826240:12345-192.168.204.31@tcp:103:bash.0 Request processed in 133us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.163883:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1787787440.165838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787440.165921:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484826368 00000100:00100000:0.0:1787787440.165940:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484826368 00000100:00100000:0.0:1787787440.165989:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:0.0:1787787440.165997:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+36:15681:x1874630484826368:12345-192.168.204.31@tcp:58:bash.0 00010000:00010000:0.0:1787787440.166090:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.166107:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.166119:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787440.167813:0:17154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787440.168281:0:17154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787787440.168425:0:17154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787787440.168560:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+36:15681:x1874630484826368:12345-192.168.204.31@tcp:58:bash.0 Request processed in 2557us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787440.168571:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:2.0:1787787440.171295:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787440.171382:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484826496 00000100:00100000:3.0:1787787440.171392:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484826496 00000100:00100000:3.0:1787787440.171482:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:3.0:1787787440.171492:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+36:15681:x1874630484826496:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787440.171513:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787440.171534:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8666 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.171590:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.171601:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.171639:0:17153:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.171654:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.171668:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787440.171671:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787440.171675:0:17153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.171683:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:3.0:1787787440.171783:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15681:x1874630484826496:12345-192.168.204.31@tcp:101:bash.0 Request processed in 292us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.171790:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00010000:00010000:0.0:1787787440.874314:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787441.001607:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503776384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787441.001700:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.001877:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503776512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787441.001908:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.001939:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503776384 00000100:00100000:3.0:1787787441.001945:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503776384 00000100:00100000:3.0:1787787441.002001:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503776512 00000100:00100000:3.0:1787787441.002004:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503776512 00000100:00100000:3.0:1787787441.002019:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787441.002027:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503776384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787441.002060:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787441.002100:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503776384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.002117:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787441.002156:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787441.002164:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503776512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787441.002180:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787441.002214:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503776512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.002222:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787787441.002241:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787441.002245:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787441.002274:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503776640:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.002283:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503777024:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002311:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787441.002334:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.002341:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503777152:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.002363:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503777536:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.002395:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503777664:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.002410:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.002430:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c454da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503776256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787441.002460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787441.002477:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503776512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787441.002482:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503776768:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.002499:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787787441.002507:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503776896:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002514:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.002537:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503777280:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002562:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.002577:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503777792:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002599:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.002624:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777152 00000100:00100000:3.0:1787787441.002627:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777152 00000100:00100000:3.0:1787787441.002660:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777280 00000100:00100000:3.0:1787787441.002664:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777280 00000100:00100000:3.0:1787787441.002682:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787441.002688:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc10b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503777152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002719:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc10b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503777152:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.002725:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787441.002735:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787441.002741:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503777280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002781:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503777280:12345-0@lo:400:kworker.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.002787:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787787441.002803:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787441.002805:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787441.002821:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503777280:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.002849:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503776256 00000100:00100000:3.0:1787787441.002853:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503776256 00000100:00100000:3.0:1787787441.002868:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787441.002874:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503776256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787441.002884:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787441.002913:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503776256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.002920:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787441.002944:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c454da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503776256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787441.002972:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777024 00000100:00100000:3.0:1787787441.002975:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777024 00000100:00100000:3.0:1787787441.002995:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503776768 00000100:00100000:3.0:1787787441.003002:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503776768 00000100:00100000:3.0:1787787441.003017:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787441.003022:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503777024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.003053:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503777024:12345-0@lo:400:kworker.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.003060:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787441.003070:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787441.003076:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503776768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.003105:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503776768:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.003111:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787441.003127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787441.003182:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503777152:0@lo:400:kworker.0 00000100:00100000:3.0:1787787441.003205:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503776768:0@lo:400:kworker.0 00000100:00100000:1.0:1787787441.003306:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503776384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787441.003327:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777536 00000100:00100000:1.0:1787787441.003330:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777536 00000100:00100000:1.0:1787787441.003368:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777792 00000100:00100000:1.0:1787787441.003371:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777792 00000100:00100000:1.0:1787787441.003384:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777664 00000100:00100000:1.0:1787787441.003386:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777664 00000100:00100000:1.0:1787787441.003399:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787787441.003406:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503777536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787441.003436:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503777536:12345-0@lo:400:kworker.0 Request processed in 31us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.003441:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787787441.003451:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787441.003456:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503777792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787441.003483:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503777792:12345-0@lo:400:kworker.0 Request processed in 27us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.003496:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787441.003508:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787787441.003514:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503777664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787441.003544:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503777664:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.003550:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1787787441.003576:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f0b40 x1874630503777664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787441.003586:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503777664:0@lo:400:kworker.0 00000100:00100000:1.0:1787787441.003607:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503777792:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.004039:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787441.004092:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503776640 00000100:00100000:0.0:1787787441.004097:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503776640 00000100:00100000:2.0:1787787441.004131:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503777408:0@lo:400:kworker.0 00000100:00100000:0.0:1787787441.004133:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787787441.004167:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.004187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787441.004219:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503776640:12345-0@lo:400:kworker.0 Request processed in 54us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.004225:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787787441.004267:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503776640:0@lo:400:kworker.0 00000100:00080000:3.0:1787787441.004434:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787441.004439:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787441.007672:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503777920:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.007737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787441.011391:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503776896 00000100:00100000:0.0:1787787441.011391:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777408 00000100:00100000:1.0:1787787441.011406:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503776896 00000100:00100000:0.0:1787787441.011406:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777408 00000100:00100000:0.0:1787787441.011475:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787787441.011485:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503777408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787441.011680:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787441.011692:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503776896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787441.011701:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503777408:12345-0@lo:400:kworker.0 Request processed in 206us (7502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.011711:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787441.011736:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503776896:12345-0@lo:400:kworker.0 Request processed in 48us (7699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.011744:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787787441.011993:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503777920 00000100:00100000:0.0:1787787441.011998:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503777920 00000100:00100000:2.0:1787787441.012009:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503777024:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.012027:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503777536:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.012062:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503776896:0@lo:400:kworker.0 00000100:00100000:2.0:1787787441.012074:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503777408:0@lo:400:kworker.0 00000100:00100000:0.0:1787787441.012097:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787441.012105:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503777920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787441.012169:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503777920:12345-0@lo:400:kworker.0 Request processed in 64us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.012176:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787787441.012341:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787787441.012345:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f1a40 x1874630503777920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787441.012358:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503777920:0@lo:400:kworker.0 00000040:00080000:3.0:1787787441.129789:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787787441.129799:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787441.129825:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787787441.129846:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787787441.129978:0:17186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17186:1874630503778048:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787441.130068:0:17186:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2ddf900 going to sleep for 11 seconds 00000100:00100000:2.0:1787787441.144605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.144794:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484826624 00000100:00100000:0.0:1787787441.144804:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484826624 00000100:00100000:3.0:1787787441.144852:0:17186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17186:1874630503778048:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787441.144896:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:0.0:1787787441.144906:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15683:x1874630484826624:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787787441.144935:0:17153:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787441.145048:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15683:x1874630484826624:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 142us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.145055:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00080000:1.0:1787787441.145123:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787441.148686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.148786:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484826752 00000100:00100000:0.0:1787787441.148795:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484826752 00000100:00100000:0.0:1787787441.148862:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:0.0:1787787441.148871:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15683:x1874630484826752:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787787441.148939:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.148956:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.148968:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.149020:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.149028:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.149050:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.149075:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.149085:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.149092:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787441.149237:0:18576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787441.149242:0:18576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787441.150869:0:18576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150893:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150900:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150924:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150931:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787441.150935:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150944:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150961:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a1c700) 00010000:00010000:1.0:1787787441.150964:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787441.150969:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150976:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659200/0x11620bc3f30aa5fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150992:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.150998:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151002:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151006:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787441.151009:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151026:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151035:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9870d0b9e400) 00010000:00010000:1.0:1787787441.151037:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787441.151040:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151045:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa601 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151059:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151065:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151069:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151074:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787441.151076:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151081:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151087:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787441.151089:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787441.151092:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.151107:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa608 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787441.152549:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15683:x1874630484826752:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 Request processed in 3670us (3865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.152563:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:2.0:1787787441.156361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.156464:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484827008 00000100:00100000:0.0:1787787441.156475:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484827008 00000100:00100000:0.0:1787787441.156572:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:0.0:1787787441.156583:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+37:15683:x1874630484827008:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787441.156606:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787441.156627:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658800/0x11620bc3f30aa60f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c866d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156757:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156771:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156783:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787441.156812:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787787441.156901:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156909:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156915:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156922:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787441.156926:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156933:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156945:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787441.156948:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787441.156952:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.156959:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa616 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.157002:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658800/0x11620bc3f30aa60f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c866d expref: 39 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.157013:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a1c700) 00010000:00010000:0.0:1787787441.157015:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787441.157025:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658800/0x11620bc3f30aa60f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c866d expref: 39 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.157035:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658800, rc 0) 00000100:00100000:0.0:1787787441.157105:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15683:x1874630484827008:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 525us (755us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1787787441.157113:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1787787441.162662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.163059:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484827136 00000100:00100000:3.0:1787787441.163069:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484827136 00000100:00100000:3.0:1787787441.163176:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1787787441.163195:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15683:x1874630484827136:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787787441.163235:0:17154:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787787441.163362:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15683:x1874630484827136:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 169us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.163370:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:1.0:1787787441.167608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.167873:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484827392 00000100:00100000:2.0:1787787441.167897:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484827392 00000100:00100000:2.0:1787787441.167964:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787441.167975:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+38:15683:x1874630484827392:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787441.168001:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787441.168022:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30aa624 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8674 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787441.168614:0:17152:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1787787441.168621:0:17152:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787787441.168643:0:17152:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787787441.169063:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa62b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.169078:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa62b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.169090:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa62b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.169485:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2e00/0x11620bc3f30aa624 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8674 expref: 41 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.169503:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa62b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8674 expref: 40 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.169511:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff986fc39d3e00) 00010000:00010000:2.0:1787787441.169514:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787441.169517:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2400, rc 0) 00000100:00100000:2.0:1787787441.169716:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+40:15683:x1874630484827392:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 1742us (2116us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787787441.169725:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787441.175131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.175292:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484827648 00000100:00100000:3.0:1787787441.175303:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484827648 00000100:00100000:3.0:1787787441.175363:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:3.0:1787787441.175372:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+40:15683:x1874630484827648:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787441.175429:0:17154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787441.175457:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2400/0x11620bc3f30aa62b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8674 expref: 40 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175474:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff986fc39d3e00) 00010000:00010000:3.0:1787787441.175484:0:17154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787441.175505:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175519:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175529:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175544:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175551:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175572:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175634:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175641:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175647:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175653:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.175657:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175664:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175672:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:3.0:1787787441.175674:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.175678:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175683:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6a00/0x11620bc3f30aa639 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175692:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175698:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175713:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175718:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.175721:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175727:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175735:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa9f9850b (ffff986fc2a1c500) 00010000:00010000:3.0:1787787441.175738:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.175741:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.175747:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aa640 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa9f9850b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787441.176018:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+39:15683:x1874630484827648:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 646us (896us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787441.176025:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:2.0:1787787441.179847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.180059:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484827776 00000100:00100000:0.0:1787787441.180070:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484827776 00000100:00100000:0.0:1787787441.180609:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:0.0:1787787441.180620:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+39:15683:x1874630484827776:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787441.180649:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787441.180672:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658800/0x11620bc3f30aa647 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c867b expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.180716:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa64e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.180730:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa64e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.180741:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa64e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.180864:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658800/0x11620bc3f30aa647 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c867b expref: 41 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.180890:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa64e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c867b expref: 40 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.180916:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.180919:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787441.180922:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658200, rc 0) 00000100:00100000:0.0:1787787441.180995:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+40:15683:x1874630484827776:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 378us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.181003:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:1.0:1787787441.185493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.186208:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484828032 00000100:00100000:2.0:1787787441.186220:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484828032 00000100:00100000:0.0:1787787441.186376:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:0.0:1787787441.186388:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+40:15683:x1874630484828032:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787441.186469:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.186485:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.186498:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787441.186666:0:17153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787787441.186676:0:17153:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 585368537140ns, next at 586368534879ns, rc = 0 00000004:00010000:0.0:1787787441.187058:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cc2fc3f reply state 000000007dd5b650 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.187073:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.187081:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.187084:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787787441.187099:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787441.187382:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+42:15683:x1874630484828032:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 995us (1897us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1787787441.187390:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:1.0:1787787441.190609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.190685:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484828160 00000100:00100000:0.0:1787787441.190694:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484828160 00000100:00100000:0.0:1787787441.190757:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:0.0:1787787441.190766:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+42:15683:x1874630484828160:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787441.190790:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787441.190811:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8682 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.190878:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 43 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.190904:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 43 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.190924:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.190927:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787441.190931:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658400, rc 0) 00000100:00100000:0.0:1787787441.191041:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+43:15683:x1874630484828160:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 276us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.191049:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:3.0:1787787441.195672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787441.196079:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484828288 00000100:00100000:1.0:1787787441.196089:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484828288 00000100:00100000:1.0:1787787441.196308:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1787787441.196319:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c46d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2391:x1874630484828288:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787787441.196557:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c46d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2391:x1874630484828288:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 239us (895us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787787441.196565:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00080000:3.0:1787787441.198353:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787441.199905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.199973:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484828544 00000100:00100000:3.0:1787787441.199982:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484828544 00000100:00100000:3.0:1787787441.200085:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:3.0:1787787441.200095:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+43:15683:x1874630484828544:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787787441.200341:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+44:15683:x1874630484828544:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 247us (443us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787787441.200363:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:0.0:1787787441.204667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787441.204849:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484828800 00000100:00100000:1.0:1787787441.204858:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484828800 00000100:00100000:1.0:1787787441.205058:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:1.0:1787787441.205070:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+44:15683:x1874630484828800:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787787441.205229:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+44:15683:x1874630484828800:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 162us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.205238:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:2.0:1787787441.209657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787441.210456:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484828928 00000100:00100000:1.0:1787787441.210465:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484828928 00000100:00100000:1.0:1787787441.210552:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:1.0:1787787441.210561:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+44:15683:x1874630484828928:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787441.210581:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787441.210603:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa663 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8689 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.210685:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa66a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.210699:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa66a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.210711:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa66a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787441.210874:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787441.210918:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa66a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.210944:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5800/0x11620bc3f30aa663 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8689 expref: 46 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.210962:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa66a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8689 expref: 45 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.210970:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:1.0:1787787441.210974:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787787441.210977:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4600, rc 0) 00000100:00100000:1.0:1787787441.211098:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+45:15683:x1874630484828928:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 537us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787441.211115:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:2.0:1787787441.216425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.216521:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484829056 00000100:00100000:3.0:1787787441.216531:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484829056 00000100:00100000:3.0:1787787441.216585:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:3.0:1787787441.216594:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2392:x1874630484829056:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787441.216613:0:18656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787441.216632:0:18656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8690 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787441.216655:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f78b1, blocks: 0x0 00010000:00010000:3.0:1787787441.216673:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1787787441.216678:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787441.216688:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 7 pid: 18656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.216781:0:18656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 7 pid: 18656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.216796:0:18656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:3.0:1787787441.216863:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:2392:x1874630484829056:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 269us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.216871:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787441.219891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.220068:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484829312 00000100:00100000:2.0:1787787441.220081:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484829312 00000100:00100000:2.0:1787787441.220186:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:2.0:1787787441.220197:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+45:15683:x1874630484829312:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787787441.220313:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+45:15683:x1874630484829312:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 117us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787441.220321:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:2.0:1787787441.225521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787441.225638:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484829440 00000100:00100000:1.0:1787787441.225649:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484829440 00000100:00100000:1.0:1787787441.225790:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:1.0:1787787441.225802:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+45:15683:x1874630484829440:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787787441.230924:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1787787441.230953:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787787441.231015:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1787787441.231237:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.231257:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.231265:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.231272:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787441.231277:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.231284:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.231301:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:0.0:1787787441.231304:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787787441.231310:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787441.231320:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+20:15683:x1874630484829440:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 Request processed in 5514us (5802us total) trans 0 rc 0/0 00010000:00010000:0.0:1787787441.231321:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659a00/0x11620bc3f30aa487 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787441.231342:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:0.0:1787787441.231355:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787441.231612:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503778176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787787441.231665:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787441.231713:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503778176 00000100:00100000:1.0:1787787441.231722:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503778176 00000100:00100000:1.0:1787787441.231770:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787441.231779:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503778176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787787441.232082:0:18658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787787441.232086:0:18658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787787441.232088:0:18658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787787441.232091:0:18658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787787441 -> 1787787441 00002000:00010000:1.0:1787787441.232093:0:18658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1787787441.232132:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232168:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232184:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232190:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.232194:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232201:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232213:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9870d0b9ed00) 00010000:00010000:3.0:1787787441.232216:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.232220:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232227:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658c00/0x11620bc3f30aa433 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232245:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232252:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232258:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.232263:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.232266:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787441.232334:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1874630503778176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 555us (666us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787787441.232342:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787787441.234439:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234466:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:3.0:1787787441.234468:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.234474:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234482:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659c00/0x11620bc3f30aa43a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234507:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234513:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234519:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234525:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.234528:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234534:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234541:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9870d8b94300) 00010000:00010000:3.0:1787787441.234543:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.234547:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234568:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5600/0x11620bc3f30aa4e2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234588:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234593:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234598:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234602:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.234605:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234610:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234617:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787441.234619:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.234622:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234629:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658a00/0x11620bc3f30aa567 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234637:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234642:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234653:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234657:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.234660:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234665:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234672:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787441.234674:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.234676:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234681:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa58a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.234692:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787441.235070:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff987101f78f00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1787787441.235081:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503778176:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787787441.236161:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236188:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236195:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.236199:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236224:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236239:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787441.236242:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787441.236247:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236253:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aa5d0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236274:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236797:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236804:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236809:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787441.236812:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236818:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236838:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:3.0:1787787441.236841:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787787441.236845:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.236873:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659400/0x11620bc3f30aa655 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787441.240264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.240576:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484829568 00000100:00100000:2.0:1787787441.240591:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484829568 00000100:00100000:2.0:1787787441.240683:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:2.0:1787787441.240693:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:2391:x1874630484829568:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787787441.240816:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:2391:x1874630484829568:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 Request processed in 124us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787441.240824:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1787787441.245762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.245873:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484829824 00000100:00100000:0.0:1787787441.245883:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484829824 00000100:00100000:0.0:1787787441.245985:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:0.0:1787787441.245995:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+14:15683:x1874630484829824:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787441.246048:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787441.246078:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4600/0x11620bc3f30aa66a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8689 expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.246107:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.246112:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787441.246174:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.246190:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.246201:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787441.246326:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d0eefc1 reply state 00000000ca42a76c transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.246339:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.246345:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.246348:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787441.246350:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787441.246478:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+15:15683:x1874630484829824:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 484us (726us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787787441.246487:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:0.0:1787787441.250520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.250629:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484829952 00000100:00100000:3.0:1787787441.250640:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484829952 00000100:00100000:3.0:1787787441.250716:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:3.0:1787787441.250727:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:15683:x1874630484829952:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787441.250746:0:18656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787441.250765:0:18656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8697 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.250797:0:18656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 8 pid: 18656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.250807:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787441.250812:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787441.250817:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 8 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.250864:0:18656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 8 pid: 18656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.250879:0:18656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 8 pid: 18656 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787441.250904:0:18656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18656:1874630503778304:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787441.251001:0:18656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0f119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787441.256322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.256368:0:18656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc42970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18656:1874630503778304:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787441.256395:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830080 00010000:00010000:0.0:1787787441.256404:0:18656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 8 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.256405:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830080 00010000:00010000:0.0:1787787441.256438:0:18656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031200, rc 0) 00010000:00010000:2.0:1787787441.256446:0:18684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 9 pid: 18656 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.256492:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1787787441.256503:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:2391:x1874630484830080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787787441.256509:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:15683:x1874630484829952:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 5781us (5998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.256519:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00010000:00010000:2.0:1787787441.256526:0:18684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787441.256549:0:18684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 8 pid: 18656 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.256563:0:18684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 8 pid: 18656 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.256587:0:18684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009458d7b7/0x11620bc3f30aa671 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8690 expref: 8 pid: 18656 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.256603:0:18684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787441.256607:0:18684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787441.256613:0:18684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 7 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.256686:0:18684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 7 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.256731:0:18684:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 7 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.256844:0:18684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18684:1874630503778432:192.168.204.31@tcp:105: 00000100:00100000:2.0:1787787441.256895:0:18684:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101f77240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787441.265034:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.265089:0:18684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18684:1874630503778432:192.168.204.31@tcp:105: 00010000:00010000:2.0:1787787441.265115:0:18684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787441.265210:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:2391:x1874630484830080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8708us (8898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.265210:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830208 00000100:00100000:0.0:1787787441.265217:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830208 00000100:00100000:2.0:1787787441.265220:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787441.265259:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:0.0:1787787441.265268:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:2391:x1874630484830208:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787787441.265422:0:18658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787787441.265426:0:18658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787787440 00002000:00010000:0.0:1787787441.265428:0:18658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787787438 00002000:00010000:0.0:1787787441.265431:0:18658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787787441 -> 1787787440 00002000:00010000:0.0:1787787441.265433:0:18658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787787441.265458:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:2391:x1874630484830208:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 192us (434us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787787441.265465:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:2.0:1787787441.271477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.272953:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830336 00000100:00100000:3.0:1787787441.272968:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830336 00000100:00100000:3.0:1787787441.273041:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787441.273052:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:2392:x1874630484830336:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787787441.273099:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.273132:0:19542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 8 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.273451:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787441.273456:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787441.273462:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.273712:0:19542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 8 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.273729:0:19542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 8 pid: 18656 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.273744:0:19542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19542:1874630503778560:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787441.273847:0:19542:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101f77240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787441.277706:0:19542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19542:1874630503778560:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787441.277749:0:19542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.283576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.286757:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830464 00000100:00100000:3.0:1787787441.286774:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830464 00010000:00010000:2.0:1787787441.287214:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 9 pid: 18656 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.287336:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:2.0:1787787441.287348:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:2391:x1874630484830464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787441.287365:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787441.287386:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 9 pid: 18656 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.287403:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 9 pid: 18656 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.287428:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac2feec/0x11620bc3f30aa67f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8697 expref: 9 pid: 18656 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.287446:0:17139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787441.287451:0:17139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787441.287457:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.287468:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.287503:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787441.287574:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:2391:x1874630484830464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 228us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787441.287583:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00010000:00010000:3.0:1787787441.290548:0:19542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290571:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290601:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290630:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290639:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290645:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787441.290649:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290658:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290678:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.290686:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25f195f/0x11620bc3f30aa686 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787441.290795:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:2392:x1874630484830336:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 Request processed in 17741us (19324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.290804:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:2.0:1787787441.294318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787441.294431:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830720 00000100:00100000:1.0:1787787441.294441:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830720 00000100:00100000:1.0:1787787441.294495:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:1.0:1787787441.294504:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+15:15683:x1874630484830720:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787787441.294592:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.294609:0:18576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 15 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.294619:0:18576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.294650:0:18576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 15 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.294664:0:18576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 15 pid: 18576 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787441.294678:0:18576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c454cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18576:1874630503778688:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787441.294744:0:18576:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787441.297548:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.297648:0:18576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c454cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18576:1874630503778688:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787441.297676:0:18576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787441.297740:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830848 00000100:00100000:3.0:1787787441.297747:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830848 00010000:00010000:3.0:1787787441.297781:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 16 pid: 18576 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787441.297846:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:3.0:1787787441.297856:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+16:2391:x1874630484830848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787441.297871:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787441.297878:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 16 pid: 18576 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.297901:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 16 pid: 18576 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.297924:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aa560 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8635 expref: 16 pid: 18576 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.298077:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:3.0:1787787441.298084:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.298094:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.298101:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.298109:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298304:0:18576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298312:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298521:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298534:0:18576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 16 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298543:0:18576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298574:0:18576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 16 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.298590:0:18576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 16 pid: 17152 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.298603:0:18576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18576:1874630503778816:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787441.298690:0:18576:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787787441.298896:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787441.299121:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+16:2391:x1874630484830848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1265us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.299167:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787441.305336:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.305733:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484830976 00000100:00100000:0.0:1787787441.305743:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484830976 00010000:00010000:0.0:1787787441.305784:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 16 pid: 17152 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787441.305852:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:0.0:1787787441.305861:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5baf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+16:2394:x1874630484830976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787441.305876:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787441.305893:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 16 pid: 17152 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.305907:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 16 pid: 17152 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.305930:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.305944:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.305954:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.305962:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.305982:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787441.306036:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5baf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+16:2394:x1874630484830976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 176us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.306045:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00010000:00010000:2.0:1787787441.306232:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa65c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8682 expref: 15 pid: 17152 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.306267:0:18576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18576:1874630503778816:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787441.306287:0:18576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.306296:0:18576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.306302:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787441.306414:0:18576:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787787441.306525:0:18576:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787787441.306560:0:18576:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787787441.306630:0:18576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18576:1874630503778944:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787787441.306673:0:18576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787441.306713:0:18576:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101f77240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787441.307757:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503778944 00000100:00100000:0.0:1787787441.307768:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503778944 00000100:00100000:0.0:1787787441.307839:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787787441.307848:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18576:x1874630503778944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787787441.307998:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18576:x1874630503778944:12345-0@lo:1000:mdt00_003.0 Request processed in 150us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.308005:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787787441.308048:0:18576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18576:1874630503778944:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787787441.308254:0:18576:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1787787441.308313:0:18576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18576:1874630503779072:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787787441.308349:0:18576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787441.308376:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779072 00000100:00100000:0.0:1787787441.308380:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779072 00000100:00100000:0.0:1787787441.308406:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787441.308412:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18576:x1874630503779072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787787441.308525:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18576:x1874630503779072:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (175us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787787441.308532:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787441.308553:0:18576:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787441.308572:0:18576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18576:1874630503779072:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787787441.308606:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308615:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308621:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308627:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787441.308631:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308644:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308659:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:0.0:1787787441.308662:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787441.308667:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308673:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa694 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308700:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308707:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308713:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308717:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787441.308720:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308726:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308734:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787441.308737:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787441.308743:0:18576:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308766:0:18576:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308775:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.308843:0:18576:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787441.308855:0:18576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18576:1874630503779200:192.168.204.31@tcp:105: 00000100:00100000:0.0:1787787441.308907:0:18576:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f3572b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787441.312920:0:18576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18576:1874630503779200:192.168.204.31@tcp:105: 00010000:00010000:0.0:1787787441.312962:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.312973:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa5ec lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313006:0:18576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313020:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313033:0:18576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313043:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313065:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313072:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313078:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787441.313577:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313590:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313604:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787441.313607:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787441.313611:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313618:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658600/0x11620bc3f30aa69b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313630:0:18576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313635:0:18576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313640:0:18576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313645:0:18576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787441.313656:0:18576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313662:0:18576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313670:0:18576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787441.313673:0:18576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787441.313676:0:18576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.313682:0:18576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4000/0x11620bc3f30aa68d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787441.313875:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+18:15683:x1874630484830720:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 19369us (19562us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787787441.313885:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000020:00080000:0.0:1787787441.313890:0:18576:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787787441.314767:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787787441.316122:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787441.316182:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787787441.316189:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787787441.316856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.317672:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484831104 00000100:00100000:3.0:1787787441.317685:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484831104 00000100:00100000:3.0:1787787441.317739:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:3.0:1787787441.317750:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+18:15681:x1874630484831104:12345-192.168.204.31@tcp:49:bash.0 00000100:00100000:3.0:1787787441.317902:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+18:15681:x1874630484831104:12345-192.168.204.31@tcp:49:bash.0 Request processed in 154us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.317911:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787441.318021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.318167:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484831360 00000100:00100000:3.0:1787787441.318172:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484831360 00000100:00100000:3.0:1787787441.318193:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:3.0:1787787441.318200:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+18:15683:x1874630484831360:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787787441.318433:0:17156:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787441.318465:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1787787441.318499:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.318516:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.318527:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.318536:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.318543:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.318565:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.318588:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787441.318650:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+20:15683:x1874630484831360:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 449us (628us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1787787441.318658:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000020:00080000:3.0:1787787441.318662:0:17156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787787441.318864:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787441.318871:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.318878:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787441.318881:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.318890:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.318903:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:2.0:1787787441.318912:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787787441.318917:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.318923:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aa6a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.318935:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787441.318937:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787441.318939:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787441.324456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.324539:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484831488 00000100:00100000:0.0:1787787441.324548:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484831488 00000100:00100000:0.0:1787787441.324605:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:0.0:1787787441.324615:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+7:15681:x1874630484831488:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787441.324631:0:18656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787441.324650:0:18656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000551286a8/0x11620bc3f30aa6a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c869e expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787441.324673:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f78b0, atime: 0x6a8f78ae, ctime: 0x6a8f78b0, blocks: 0x0 00010000:00010000:0.0:1787787441.324694:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1787787441.324712:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787441.324722:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551286a8/0x11620bc3f30aa6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c869e expref: 8 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.324739:0:18656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000551286a8/0x11620bc3f30aa6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c869e expref: 8 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.324751:0:18656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658600, rc 0) 00000100:00100000:0.0:1787787441.324897:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:15681:x1874630484831488:12345-192.168.204.31@tcp:101:bash.0 Request processed in 283us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.324905:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:1.0:1787787441.339924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.341310:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484831616 00000100:00100000:0.0:1787787441.341326:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484831616 00000100:00100000:0.0:1787787441.341623:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:0.0:1787787441.341637:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+20:15681:x1874630484831616:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787441.341666:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787441.341689:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa6b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c86a5 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.341730:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa6b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.341744:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.341757:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.341894:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659000/0x11620bc3f30aa6b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86a5 expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.341921:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86a5 expref: 21 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.341930:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:0.0:1787787441.341933:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787441.341937:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658400, rc 0) 00000100:00100000:0.0:1787787441.342086:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15681:x1874630484831616:12345-192.168.204.31@tcp:101:bash.0 Request processed in 452us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.342094:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:2.0:1787787441.345319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787441.345546:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484831872 00000100:00100000:3.0:1787787441.345557:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484831872 00000100:00100000:3.0:1787787441.346005:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:3.0:1787787441.346017:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+21:15681:x1874630484831872:12345-192.168.204.31@tcp:35:bash.0 00000001:00080000:3.0:1787787441.346263:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787787441.347104:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787787441.347268:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+24:15681:x1874630484831872:12345-192.168.204.31@tcp:35:bash.0 Request processed in 1250us (1955us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787787441.347279:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000020:00080000:3.0:1787787441.347285:0:17156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787787441.427768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.427900:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484832128 00000100:00100000:2.0:1787787441.427910:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484832128 00000100:00100000:2.0:1787787441.427978:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:2.0:1787787441.427988:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+24:15693:x1874630484832128:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787441.428011:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787441.428033:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c86ac expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787441.428132:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787787441.428267:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86ac expref: 26 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.428282:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:2.0:1787787441.428286:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787441.428290:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86ac expref: 26 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.428303:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787441.428380:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15693:x1874630484832128:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 394us (621us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787787441.428388:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:1.0:1787787441.435983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787441.436119:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484832256 00000100:00100000:2.0:1787787441.436129:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484832256 00000100:00100000:2.0:1787787441.436219:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:2.0:1787787441.436229:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15693:x1874630484832256:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:2.0:1787787441.436312:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436329:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436341:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436356:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436363:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436369:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436441:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436450:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436456:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787441.436511:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436524:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436530:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436537:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436543:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787441.436547:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436555:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436568:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:2.0:1787787441.436570:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787441.436575:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436581:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3a00/0x11620bc3f30aa6cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436594:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436599:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436610:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436615:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787441.436618:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436623:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436629:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff986fc3a1dd00) 00010000:00010000:2.0:1787787441.436632:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787441.436634:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436640:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2a00/0x11620bc3f30aa6d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436652:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436657:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436662:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436667:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787441.436669:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436684:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436692:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:2.0:1787787441.436694:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787441.436697:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.436702:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3800/0x11620bc3f30aa6da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.436775:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15693:x1874630484832256:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 547us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787441.436783:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:3.0:1787787441.439518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787441.439586:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484832512 00000100:00100000:0.0:1787787441.439595:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484832512 00000100:00100000:0.0:1787787441.439649:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:0.0:1787787441.439660:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+25:15693:x1874630484832512:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787441.439883:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+26:15693:x1874630484832512:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 224us (373us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1787787441.439891:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00010000:00010000:0.0:1787787441.903463:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787442.359721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359764:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359946:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787442.359982:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484832896 00000100:00100000:1.0:1787787442.359992:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484832896 00000100:00100000:1.0:1787787442.360051:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484832768 00000100:00100000:1.0:1787787442.360054:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484832768 00000100:00100000:1.0:1787787442.360066:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833280 00000100:00100000:1.0:1787787442.360068:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833280 00000100:00100000:1.0:1787787442.360081:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833408 00000100:00100000:1.0:1787787442.360084:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833408 00000100:00100000:1.0:1787787442.360101:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:1.0:1787787442.360110:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c454cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484832896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360210:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c454cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484832896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 100us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360217:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:1.0:1787787442.360236:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:1.0:1787787442.360242:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+26:2393:x1874630484832768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360270:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+26:2393:x1874630484832768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360276:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:1.0:1787787442.360287:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:1.0:1787787442.360293:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2394:x1874630484833280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360315:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2394:x1874630484833280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360320:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:1.0:1787787442.360339:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:1.0:1787787442.360345:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484833408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360383:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484833408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360389:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:1.0:1787787442.360410:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833024 00000100:00100000:1.0:1787787442.360413:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833024 00000100:00100000:1.0:1787787442.360436:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833536 00000100:00100000:1.0:1787787442.360438:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833536 00000100:00100000:1.0:1787787442.360453:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833152 00000100:00100000:1.0:1787787442.360455:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833152 00000100:00100000:1.0:1787787442.360464:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833664 00000100:00100000:1.0:1787787442.360466:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833664 00000100:00100000:1.0:1787787442.360478:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1787787442.360483:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:2394:x1874630484833024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360509:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:2394:x1874630484833024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360515:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1787787442.360527:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787442.360533:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484833536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360555:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484833536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360561:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787442.360574:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:1.0:1787787442.360580:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484833152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360603:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2394:x1874630484833152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360615:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:1.0:1787787442.360627:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:1.0:1787787442.360633:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484833664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787442.360659:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4282940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2394:x1874630484833664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787442.360664:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00080000:1.0:1787787442.360695:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787442.360699:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787442.360702:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787442.360704:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787442.361477:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484832640 00000100:00100000:0.0:1787787442.361485:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484832640 00000100:00100000:0.0:1787787442.361525:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 168 00000100:00100000:0.0:1787787442.361533:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2393:x1874630484832640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787442.361564:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2393:x1874630484832640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787442.361570:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 168 00000001:02000400:3.0:1787787442.809386:0:20329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1787787442.924121:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787443.051882:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787443.051909:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4295e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503779328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787443.051978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787443.053351:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779328 00000100:00100000:3.0:1787787443.053362:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779328 00000100:00100000:3.0:1787787443.053434:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787443.053444:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503779328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787443.053474:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787787443.053536:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503779328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787443.053556:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787787443.055182:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787443.055237:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4295e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503779328:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787787443.370453:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787787443.370462:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787443.370496:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787787443.370506:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787787443.946461:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787787444.073760:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787444.075064:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503779456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787444.075161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787444.075444:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779456 00000100:00100000:0.0:1787787444.075453:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779456 00000100:00100000:0.0:1787787444.075504:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787787444.075515:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503779456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787444.075550:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787787444.075602:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503779456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787444.075610:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787787444.076116:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503779456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787444.076384:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787444.080258:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503779584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787444.080333:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787444.082220:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779584 00000100:00100000:1.0:1787787444.082232:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779584 00000100:00100000:1.0:1787787444.082336:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787787444.082348:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503779584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787444.082385:0:20292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787444.082461:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503779584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787444.082468:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787787444.082548:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503779584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787444.399568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787444.399659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787444.399731:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833792 00000100:00100000:3.0:1787787444.399820:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833792 00002000:00100000:3.0:1787787444.399889:0:18662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9870ed924780 x1874630484833792/t0(0) o4->06eed6ec-d774-46ad-afc7-a8fd1799d109@192.168.204.31@tcp:305/0 lens 504/0 e 0 to 0 dl 1787787455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787787444.399902:0:18662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870ed924780 with x1874630484833792 ext(0->8) 00002000:00010000:3.0:1787787444.399908:0:18662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9870ed924780 00000100:00100000:3.0:1787787444.399933:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:3.0:1787787444.399944:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+8:2393:x1874630484833792:12345-192.168.204.31@tcp:4:bash.0 00000100:00100000:2.0:1787787444.400505:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484833920 00000100:00100000:2.0:1787787444.400512:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484833920 00000100:00100000:2.0:1787787444.400547:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:2.0:1787787444.400555:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:2393:x1874630484833920:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:2.0:1787787444.400649:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+9:2393:x1874630484833920:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 94us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787444.400657:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00080000:0.0:1787787444.401002:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787444.404927:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+10:2393:x1874630484833792:12345-192.168.204.31@tcp:4:bash.0 Request processed in 4973us (5256us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787787444.404942:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00002000:00100000:3.0:1787787444.404955:0:18662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9870ed924780 x1874630484833792/t8589934599(0) o4->06eed6ec-d774-46ad-afc7-a8fd1799d109@192.168.204.31@tcp:305/0 lens 504/448 e 0 to 0 dl 1787787455 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787787444.404966:0:18662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870ed924780 with x1874630484833792 ext(0->8) 00002000:00010000:3.0:1787787444.404972:0:18662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9870ed924780 Debug log: 42969 lines, 42969 kept, 0 dropped, 0 bad.